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The  issue  of  whether  the  acquisition  of  knowledge  or  whether 
the  successful  performance  of  job  like  task  should  be  the  goal  of 
education  provided  the  rationale  for  a  study  to  investigate  the 
level  of  teachers'  competency  in  teaching  reading. 

The  design  of  the  study  focused  on  the  contributions  of  the 
variables  of  level  of  training  and  experience  in  teaching  reading 
to  the  overall  level  of  proficiency  in  ten  generic  competencies  of 
reading  instruction,  measured  in  both  the  knowledge  and  performance 
domains. 

Utilizing  a  set  of  ten  generic  teacher  competencies,  which  V 
research  has  suggested  tend  to  be  associated  with  success  in  teach- 
ing children  to  read,  two  instruments  were  developed  to  assess  the 
knowledge  and  performance  dimensions  of  these  competencies  in 
teachers. 

vii 


Data  on  a  population  of  144  teachers  and  students  of  reading 
instruction  from  the  State  of  Florida  were  used  to  test  the  inter- 
action of  training  and  experience,  the  main  effects  of  training  and 
of  experience  and  the  relationship  of  knowledge  scores  and  perfor- 
mance scores.    Additional  data  on  the  ability  of  the  instruments  to 
detect  growth  resulting  from  directed  instruction  in  teaching  read- 
ing (measured  in  pre-  and  posttest  differences),  and  calculation  of 
instrument  rel iabil ity , were  obtained. 

Analysis  of  variance  results  indicated  no  interaction  of  the 
variables  of  training  and  experience  in  either  the  knowledge  or 
performance  domains.    As  main  effects,  neither  training  or  experience 
possessed  sufficient  strength  to  account  for  differences  in  subjects' 
knowledge  domain  scores,  but  both  variables  exerted  strong  indepen- 
dent influence  on  the  variance  in  subjects'  performance  domain  scores. 

Results  support  the  recommendations  that  both  instruments  devel- 
oped for  the  study  (GATER-K  and  GATER-P)  be  utilized  in  further 
research  aimed  at  monitoring  the  level  of  competence  maintained  over 
time  and  the  investigation  of  the  relationship  of  curriculum  to 
competency  acquisition  in  reading  perparation  programs  and  support 
continuing  this  assessment  in  both  the  knowledge  and  performance 
domains. 


CHAPTER  I 


THE  PROBLEM 

Introduction 

Contemporary  curriculum  development  by  such  popular  authorities 
as  Jerome  Bruner  (1960)  and  Lewis  and  Meil  (1972)  embodies  in  its 
theory  the  basic  assumption  that  the  course  of  learning  is  essentially 
vertical,  moving  from  specific  to  general,  and  from  an  early  concentra- 
tion on  knowledge  towards  an  ultimate  end  of  acceptable  ability  to  per- 
form.   In  actual  practice,  the  accumulation  of  knowledge  is  often  both 
the  initial  goal  and  the  final  outcome  of  formal  education.  . 

Prominent  scholars,  both  ancient  and  modern,  have  tended  to  view 
knowledge  as  the  key  to  education.    Bacon  (Benham,  1926,  p.  14a) 
asserted  that  "knowledge  jsjJower^jTiore  than  300  years  ago.    And  more 
recently,  Bruner  (1964,  p.  129)  affirmed  that  "Action  follows  frmwhat 
one„knows."  /This  line  of  thought  is  consistent  with  the  common  practice 
of  assuming  that  the  assessment  of  the  knowledge  dimension  of  learning 
will  prove  sufficient  to  accurately  and  reliably  predict  the  future  per- 
formance effectiveness  of  the  graduates  of  our  educational  institutions^ 

Certain  rather  obvious  limitations  exist  to  the  above  mentioned 
assumptions.  Respectively,  it  is  not  necessarily  true  that  the  nature 
of  all  learning  and  subsequently  the  curriculum  should  follow  the 
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form  of  a  vertical  spiral.    Some  aspects  of  learning  may  best  be 
approached  from  general  to  specific,'  some  may  warrant  a  horizontal 
approach,  and  others  may  require  a  structure  that  is  as  yet  unknown. 

While  Bacon  (Benham,  1926)  has  his  position, (Huxley  (Benham, 
1926,  p.  176a)  believed  that  "The  great  end  in  life  is  not  knowledge, 
but  action."   And  this  other  viewpoint  is  also  supported  by  the  proverb, 
"Knowledge  without  practice  makes  but  half  an  artist"  (Benham,  1926, 
p.  799a). 

Another  limitation  seriously  challenges  the  practice  of  one 
dimensional  assessment  of  learning.  /When  assessment  is  limited  to 
the  knowledge  base,  no  direct  evidence  can  be  offered  to  indicate  the 
actual  level  of  performance  resulting  from  this  knowledge.    Likewise,  * 
when  only  performance  is  assessed,  no  corresponding  evidence  can  be 
offered  to  indicate  the  depth  or  range  of  knowledge  that  undergirds 
the  specific  behaviors  observed./ 

These  assumptions  and  their  respective  limitations  create  a 
parallel  set  of  consequences.  (The  most  obvious  consequence  to  these 
limitations  is  the  potential  for  failure  when  the  structure  of  the 

curriculum  is  not  congruent  with  structure  of  the  intended  content) 

r  ' 

Prima  facia  evidence  of  this  pitfall  is  provided  by  the  still 
popular  synthetic  approach  to  phonics  instruction  in  the  reading 
curriculum.    While  many  proficient  readers  received  their  initial 
phonics  knowledge  in  this  manner  (synthetic),  which  reflects  strongly 
the  spiral  curriculum  approach  to  learning  to  read,  it  is  at  odds 
with  more  natural  and  efficient  strategy  of  ".  .  .  analyzing  major 
word  elements  for  sound,  blending  these  together,  and  reaching  an 
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approximate  pronunciation  of  the  unknown  word  which  should  in  turn  cue 
a  meaning  association"  (Lamb  &  Arnold,  1976,  p.  346). 

Altogether  too  many  readers  have  had  to  overcome  the  unnatural 
habits  resulting  from  this  practice.    The  acquisition  of  these  habits 
is  attributable  to  the  interface  incongruity  between  the  curriculum 
structure  and  the  structure  of  the  reading  process  to  be  learned. 

Secondly,; whether  it  is  knowledge  or  action  that  is  desired,  or 
both,  the  dimension  of  automaticity  (Fitts  &  Posner,  1967)  that  pro- 
motes utility  in  learning  is  ignored.    Thus,  the  reader  who  has 
acquired  the  requisite  knowledge  and  the  enabling  skills  may  be  able 
to  read,  but  may  never  attain  a  functional  level  in  reading  due  to  the 
fact  that  the  spiral  approach  distorted  the  reading  process  and  failed 
to  reach  the  dimension  of  automatic  processing  so  necessary  to  success- 
ful performance  and  self  generative  developmenty* 

Further  perils  exist  consequent  to  the  situation  where  lack  of 
practice  and/or  obi  iterative  subsumption  intervene  to  distort  the 
assessment  data  and  render  invalid  conclusions  about  the  quality  and 
quantity  of  instruction  that  has  occurred,  (while  it  is  practice  that 
ultimately  leads  to  automaticity  of  performance,  it  is  also  practice 
that  can  account  for  the  resulting  obi  iterative  subsumption  of  know- 
ledge and  skills  to  the  point  that  "the  specific  items  become  spon- 
taneously and  progressively  less  dissociable  from  their  anchoring 
ideas  as  entities  in  their  own  right,  until  they  are  no  longer  avail- 
able and  are  said  to  be  forgotterfV^Ausubel ,  Novak,  &  Harrison,  1978, 
p.  129-30).  (Quite  obviously,  also,  lack  of  practice  can  lead  to  the 
final  extinction  of  previously  acquired  learning  if  the  stage  at  which 
the  piecemeal  learning  becomes  consolidated  has  not  been  reached.) 


The  above  considerations  lend  strong  support  to  an  approach  to 
assessment  that  as  Tyler  (1949)  suggests  needs  to  include  both  the 
cognitive  criteria  and  the  behavioral  outcomes  expected  of  the  learner. 

/Reading  educators  have  a  history  of  promoting  a  multidimensional 
approach  to  curriculum  instruction,  and  assessment  in  the  teaching  of 
reading.  Notable  for  this  work  in  the  field  are  Betts  (1950),  Harris 
(1970),  Durrell  (1940),  and  others  who  have  considered  the  multiple 
dimensions  of  what  Powell  (1975a)  has  termed  potential,  performance, 
and  placement  in  their  overall  instructional  rationales  at  the  class- 
room level./ 

The  reading  field's  record  with  respect  to  the  curriculum, 
instruction,  and  evaluation  of  its  preservice  and  inservice  practi- 
tioners, however,  has  not  been  so  broadly  based.  /While  efforts  have 
been  made  to  devise  instruments  to  assess  teacher  knowledge  in  reading 
(Artley  &  Hardin,  1971),  and  others  have  sought  to  assess  teacher 
problemsolving abilities  on  reading  instruction  tasks  (Stoll,  1971),  ^ 
and  some  have  even  assessed  teacher  effort  in  teaching  as  an  estimate 
of  teacher  effectiveness  (Blair,  1975);  a  lack  of  conclusive  evidence 
exists  as  to  the  relationships  among  these  variables/ (Powell ,  1976). 
Ik  further  reservation  is  called  for  when  the  question  of  content 
validity  is  raised  regarding  the  instruments  utilized  in  the  studies 
mentioned  above./" 

/While  previously  devised  instruments  have  been  found  to  have  a 
positive  correlation  with  student  gains  in  reading,  a  lack  of  evidence 
exists  to  verify  the  validity  of  the  content  of  these  instruments 
relative  to  the  question,  "What  knowledge  is  worth  knowing?'/ (Powel  1 , 
1976,  p.  158). 
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This  question  has  more  recently  been  confronted  as  an  outgrowth 
of  the  concern  for  and  commitment  to  improving  education  in  the  basic 
skills  in  our  public  schools.    One  such  effort  has  produced  a  set  of 
basic  teacher  competencies,  derived  from  the  research  literature,  and 
containing  both  cognitive  and  performance  dimensions  (Powell  et  a],, 
1977). 

/Involvement  by  the  present  author  in  this  project  lead  to  the 
development  of  a  series  of  task  performance  activities  that  have  the 
potential  for  assessing  a  subject's  competence  in  problem  solving 
activities  typically  encountered  in  classroom  instruction  and  have 
the  distinction  of  being  considered  as  prerequisites  to  successful 
classroom  instruction  (Powell    et  al .  ,  1978)y 

Following  upon  and  extending  beyond  the  precedents  of  earlier 
research,  the  present  study  will  attempt  to 

1.  Assess  teacher  knowledge  and  performance  capabilities  in 

each  of  ten  purportedly  distinctive  competency  areas  of  reading  instruc- 
ti  on . 

2.  Make  some  determination  as  to  whether  the  knowledge  base  is 
prerequisite  to  and  predictive  of  performance  in  the  ten  areas 
examined. 

3.  Ascertain  the  effects  of  training  and  experience  in  teaching 
reading  on  the  level  of  teacher  competency  in  both  the  knowledge  and 
performance  domains. 

4.  Explore  the  potential  of  the  instruments'  diagnostic  capa- 
bilities with  respect  to  the  ten  areas  assessed. 
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%  Assumptions  Underlying  the  Hypotheses 

If  the  concept  of  the  spiral  curriculum  is  a  valid  one,  then 
increases  in  the  level  of  teacher  preparation  should  be  reflected  by 
corresponding  increases  in  teacher  knowledge  in  a  specific  field  of 
study. 

If  knowledge  is  indeed  the  fundamental  component  of  the  curricu- 
lum, then  increases  in  the  level  of  teacher  preparation  should  be 
reflected  in  the  overall  level  of  teacher  competency  in  performance 
of  the  activities  associated  with  the  area  of  specialization. 

If  there  is  a  corresponding  relationship  between  knowledge  and 
performance  in  a  specific  area  of  specialization,  the  assessment  of 
either  dimension  should  yield  meaningful  information  as  to  the  status 
of  a  subject  in  the  other. 

To  assess  the  validity  of  the  above  assumptions,  thejfoljowing 
hypotheses  will  be  tested. 

1.  Is  there  an  interaction  effect  of  level  of  preparation 
and  years  of  experience  in  teaching  reading  on  subjects' 
competency  scores  in  either  the  knowledge  or  performance 
domains . 

2.  Are  there  main  effects  of  either  training  or  experience 
in  teaching  reading  on  the  competency  scores  of  teachers 
in  either  the  knowledge  or  performance  domains? 

3.  Is  the  level  of  teachers'  knowledge  in  teaching  reading 
related  to  their  level  of  performance  in  teaching  reading? 

Definitions  and  Terminology 

For  the  purposes  of  this  investigation,  the  following  terms  and 
definitions  shall  be  considered  operational: 

J 


1.  Teacher— a  person  who  is  either  a  student  or  practitioner 

<? 

of  reading  instruction  or  both. 

2.  Cognitive  domain  or  knowledge  base— criteria  consisting  of 
facts,  factors,  parameters,  procedures,  practices,  rules  of  generaliza- 
tions which  must  be  learned  and  stored  in  memory  for  later  use. 

3.  Performance  domain  or  performance  tasks— criteria  consisting 
of  techniques  and  processes  which  must  apply  and  utilize  certain  cogni- 
tive elements  in  the  context  of  classroom  type  activities  of  reading 
instruction  to  reach  acceptable  decisions  from  among  the  available 
alternatives. 

4.  Level  of  traininq--a  range  of  zero  to  nine  representing  the 
number  of  courses  of  study  in  reading  instruction  completed,  or  the 
attainment  of  a  State  approved  certificate  to  teach  reading. 

5.  Level  of  experience— a  range  of  zero  to  nine-plus  repre- 
senting the  number  of  years  in  which  subjects  have  been  involved  in  the 
professional  practice  of  teaching  reading. 

6.  Teacher  competencies— a  set  consisting  of  fifteen  specific 
elements  in  the  performance  domain  of  reading  instruction,  and  their 
associated  cognitive  components,  all  of  which  are  considered  to  be 
essential  prerequisites  for  effective  classroom  performance  in  the 
teaching  of  reading  (Powell  et  al . ,  1977). 

Rationale 

The  recent  trend  in  American  education  has  been  to  move  back  to 
the  basics.    The  underlying  rationale  for  this  movement  has  been  a 
general  and  pervasive  disenchantment  with  the  results,  in  terms  of 
pupil  competence,  of  the  multitude  of  programs  and  packages  for 
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teaching  which  have  consumed  vast  quantities  of  educational  resources 
only  to  yield  students  with  diplomas  and/or  degrees,  whose  ability  to 
perform  even  the  most  simple  of  on-the-job  tasks  is  inadequate. 

The  popular  feeling  is  that  while  many  things  can  be  taught, 
what  is  important  to  teach  and  teach  first  are  those  knowledges  and 
skills  that  permit  and  even  assure  that  persons  can  perform  in  the  job 
situation  those  activities  that  are  expected  of  them  in  the  role  for 
which  they  were  hired. 

From  employers  comes  the  cry,  "They  can't  even  add,"  and  "They 
can't  read'"  or  "They  can't  even  fill  out  the  forms!" 

While  it  is  appropriate  for  the  employer  to  voice  these  dissatiS' 
factions,  it  must  ultimately  be  decided  exactly  what  is  important  to 
know  and  what  is  required  to  be  done  on  the  job  in  order  to  quiet  thes( 
objections. 

In  the  case  of  skilled  and  professional  workers,  one  seemingly 
sound  approach  is  articulated  by  Bode  (1927,  p.  98)  who  observed: 

The  activities  in  connection  with  which  a  subject  matter 
may  be  used  are  analyzed  to  discover  exactly  what  the 
individual  is  to  do  and  then  the  subject  material 
necessary  to  assist  in  the  performance  of  these  activi- 
ties is  collected  and  organized.  .  .  . 

f  Quite  obviously  in  reading  education,  the  goal  of  instruction  is 

to  produce  pupils  who  can  read,  and  the  goal  of  preservice  education 

of  reading  professionals  is  to  teach  those  knowledges  and  skills  that 

eventually  produce  this  outcome.    In  considering  this  approach  to  the 

problem,  two  very  important  concerns  arise.)    First,  what  are  the 

activities  required  on  the  job  and  does  the  demonstrated  ability  to 

perform  these  activities  insure  their  use  in  the  job  role,  and 


ultimately  the  check  on  the  whole  system  is  decided  by  the  outcome: 
"Is  the  job  being  done  to  the  satisfaction  of  the  employer?" 

Previous  studies  that  sought  to  answer  these  questions  have 
yielded  answers  that  are  both  helpful  and  limited.    In  attempting  to 
provide  a  rationale  for  her  study,  Stoll  (1971)  constructed  an  instru- 
ment whose  design  was  aimed  at  assessing  teacher  problem  solving  pro- 
ficiency in  the  teaching  of  reading  as  a  means  of  providing  some 
answers  to  the  concern  for  the  vital  role  that  previous  studies  (Ram- 
sey, 1962;  Harris,  1969)  had  shown  that  the  teacher  plays  in  the  final 
outcome  of  pupils'  growth  in  learning  to  read. 

While  her  approach  did  provide  an  alternative  method  of  assessing 
teacher  competence,  and  while  her  instrument  did  demonstrate  a  measure 
of  concurrent  validity  with  respect  to  pupil  gains,  and  while  it  did 
incorporate  the  dimension  of  problem  solving  in  the  task  of  teacher 
assessment,  it  failed  to  provide  the  diagnostic  function  that  is 
needed  in  order  to  link  assessment  to  subsequent  instruction  to  improve 
performance  on  the  instrument  and  in  the  classroom.    Another  shortcom- 
ing of  interest  to  this  study  is  the  confusion  associated  with  the 
overlap  in  the  test's  subtests  with  respect  to  determining  the  domain 
(cognitive  or  performance)  that  is  represented  by  the  items. 

A  cognizance  of  the  outcomes  of  these  previous  efforts  helped 
guide  the  process  of  instrument  development  in  the  present  study.  The 
intent  was  to  avoid  replication  of  these  aforementioned  limitations. 

Beginning  with  the  need  to  determine  what  skills  are  considered 
to  be  basic  to  the  process  of  learning  to  read,  a  three  stage  model  of 
literacy  emerged  (Powell,  1975b).    This  model  provided  a  framework  for 
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the  organization  and  analysis  of  the  reading  process  into  meaningful 
stages  which  could  then  be  examined  to  ascertain  components  involved 
at  each  of  the  three  levels  (Powell  et  al . ,  1976).    This  involved  a 
rather  extensive  review  of  the  literature  to  isolate  those  components 
which  seemed  to  underlie  differences  in  the  performance  outcomes  of 
learners  at  the  various  stages  of  learning  to  read. 

Next  it  was  undertaken  to  determine  the  corresponding  teacher  com- 
petencies that  the  available  literature  suggested  were  necessary  for 
the  teacher  to  possess  in  order  to  perform  the  activities  of  the  class- 
room that  could  produce  the  desired  results  in  students.    Out  of  this 
phase  of  the  project  (Powell  et  al.,  1977)  came  the  specifications 
for  the  teacher  competencies  in  objective  format  with  both  cognitive 
and  performance  dimensions  identified. 

^It  was  at  this  stage  that  the  performance  task  approach,  utiliz- 
ing the  concept  of  simulated  instructional  situations  that  Stoll  (1971) 
had  employed,  was  merged  with  the  content  validated  specificiations  of 
Powell  et  al.  (1977)  to  yield  an  instrument  that  held  promise  for 
assessing  a  teacher's  competence  in  the  essential  activities  of  the 
job  of  teaching  reading.)  Utilizing  the  cluster  format- which  groups 
the  corresponding  objectives^  provided  a  diagnostic  dimension  that 
could  be  used  to  identify  both  the  general  and  specific  strengths  and 
weaknesses  existing  in  the  professional  fabric  of  a  teacher.    When  out- 
comes on  the  performance  instrument  are  compared  to  outcomes  on  a 
similarly  organized  cognitive  instrument,  the  relative  relationships 
between  the  competence  level  of  teacher's  knowledge  and  teacher's  per- 
formance should  be  assessable. 


CHAPTER  II 


RELATED  RESEARCH 

The  role  of  knowledge  as  a  factor  influencing  the  level  of  com- 
petence in  task  performance  has  been  debated  for  many  centuries.  The 
earliest  positions  evolved  from  philosophical  perspectives  which  lacked 
supportive  data  and  were  advanced  by  respected  "thinkers"  of  the  day. 
With  little  more  than  a  reputation  and  a  solid  logical  framework  to 
support  him,  Francis  Bacon  is  said  to  have  proclaimed  that  "Knowledge 
is  power"  (Benham,  1926,  p.  14a),  and  while  no  other  equally  profound 
quotations  exist  from  the  period  to  counter  this  position,  noteworthy 
intellectuals  have  foreseen  that  knowledge  alone  could  not  insure 
satisfactory  performance. 

According  to  the  non-Biblical  proverb,  "Knowledge  without  prac- 
tice makes  but  half  an  artist"  (Benham,  1926,  p.  799a)  and  the  theorist 
Huxley  (19825-1895)  extended  this  latter  concern  by  proposing  that  "The 
great  end  in  life  is  not  knowledge,  but  action"  (Benham,  1926,  p.  176a). 

Eventually  the  factors  of  knowledge  and  performance  had  to  be 
considered  an  issue  of  importance  with  potential  impact  on  the  process 
of  education,  both  in  the  present  and  in  the  future.    As  this  concern 
evolved,  attempts  were  made  to  examine  the  content  of  education  (know- 
ledge) relative  to  the  goals  of  education,  with  the  result  being  the 
development  of  taxonomies  of  objectives  which  served  to  further 
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specify  what  the  term  "knowledge"  really  meant.    The  whole  concept  of 
examinations,  as  we  know  them,  has  behind  it  this  rationale. 

Specifically,  the  field  of  reading  education  has  seen  the  develop- 
ment of  a  position  that  explains  the  variance  in  teacher  effectiveness 
from  the  position  that  there  exist  certain  specific,  identifiable,  and 
assessable  knowledges  whose  acquisition  is  necessary  and  related  to  the 
teacher's  performance  and  ultimately  to  student  gains  in  learning  to 
read,  and  that  one  way  to  monitor  and  predict  this  effectiveness  is  to 
examine  the  level  of  content  knowledge  that  exists  among  preservice  and 
inservice  professionals  in  reading. 

(The  logical  outcome  to  this  position  has  been  to  develop  instru- 
mentation capable  of  reliably  and  validly  measuring  this  knowledge  on 
a  differential  basis.    As  early  as  1971  (Artly  &  Hardin,  1971),  a  test 
became  available  that  sought  to  measure  the  knowledge  of  persons 
involved  in  reading  instruction  activities.    This  instrument  claims  a 
.92  reliability  index  overall^  and  has  purported  validity  (Kingston, 
Brosier,  &  Hsu,  1975)  for  the  knowledge  domains  of  the  directed  reading 
activity,  instructional  goals,  diagnosis  and  evaluation,  reading  compre- 
hension, reading  readiness,  and  word  recognition  skills  (Powell,  1976). 

Concurrent  to  this  effort,  Stoll  (1971)  took  the  position  that 
reading  instruction  was  more  a  matter  of  problem  solving  and  undertook 
to  construct  and  validate  an  instrument  to  assess  teacher  problem 
solving  ability  on  simulated  classroom  teaching  skills  tasks.    In  doing 
so,  Stoll  created  a  reading-specific  assessment  instrument  that  had 
underlying  it  the  conceptual  framework  introduced  by  Turner  and  Fattau 
(1961),  who  had  focused  on  the  assessment  of  specific  classroom  teaching 
skills  in  the  area  of  mathematics. 


13 

An  earlier  work  by  Wade  (1960)  had  also  considered  this  approach, 
but  left  some  serious  questions  relative  to  the  appropriateness  of 
procedures  used  in  scoring  the  instrument  and  further  consisted  of  a 
rather  narrow  view  of  the  reading  teacher's  problem  solving  role 
(Stoll,  1971).    However,  the  model  developed  by  Wade  did  serve  as  a 
guide  to  subsequent  studies. 

One  such  study  was  conducted  by  Richard  Burnett  (1961).  While 
noteworthy  for  its  attempt  to  measure  a  teacher's  diagnostic  problem 
solving  ability  on  interrelated  problems,  much  like  those  of  the 
actual  classroom,  this  same  approach  resulted  in  poor  task  differen- 
tiation and  was  naturally  of  little  diagnostic  value. 

A  subsequent  investigation  by  Bradtmueller  (1963)  utilized  an 
updated  version  of  Wade's  (1960)  instrumentation  to  examine  relation- 
ships that  might  exist  between  student  teaching  experience  and  pre- 
service  methods  courses  and  a  teacher's  problem  solving  ability  on 
reading  instruction  tasks.  ('The  outcomes  of  this  study  found  signifi- 
cant differences  between  the  level  of  skills  in  problem  solving  by 
supervising  teachers  and  the  general  elementary  teacher  population 
studied,  and  between  the  effects  of  the  student  teaching  experience 
and  the  problem  solving  efficiency  of  student  teachers  over  the  time 
of  their  internship^  vwhile  tne  questions  of  the  effects  of  super- 
vising teacher's  skill  on  her  student  teacher's  skill  in  problem 
solving  over  the  course  of  the  latter's  internship  were  examined,  and 
the  relationship  between  grade  level  and  student  teacher's  attainment 
in  problem  solving  proficiency  was  studied,  as  was  the  relationship 
between  grade  level  and  supervising  teacher's  problem  solving  skill. 
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and  the  differing  contributions  of  the  student  teaching  experience  and 
the  preservice  methods  courses,  no  significant  relationships,  inter- 
actions, or  differences  were  found  (Stoll,  1971).  . 

Speculation  by  Stoll  (1971)  and  an  earlier  comment  by  Turner 
(1965)  raise  serious  question  as  to  the  validity  of  the  instrumentation 
used  in  the  Bradtmueller  study  (1963),  and  it  is  this  flaw  that  is 
suggested  as  the  reason  for  the  lack  of  more  conclusive  results. 

An  attempt  to  deal  with  these  instrument  deficiencies  was  initi- 
ated by  Brown  (1968)  and  resulted  in  a  Form  C  of  the  earlier  Teacher 
'Tasks  in  Reading"  (TTC)  created  by  Wade  (1961)  and  the  "TTC,  Form-Bl " 
revised  by  Bradtmueller  (1963).    This  investigation  incorporated 
pupil  gain  scores  into  the  validation  process  and  utilized  twenty-one 
teachers  from  a  remedial  reading  summer  program  as  its  population. 
Results  were  disappointing  as  only  one  area  of  pupil  gain  (vocabulary 
achievement)  produced  any  significant  relationship  to  differences  in 
teacher  performance  on  the  "TTR,  Form  C"  and  this  difference  held  only 
for  total  score  comparisons.    Some  differential  in  teacher  task  per- 
formance (tasks  3-c,  4-c,  and  IR-3)  did  result  when  pupil  scores  in 
vocabulary,  comprehension  and  total  reading  were  used  as  criteria, 
but  the  general  conclusion  of  the  investigator  was  that  further 
revisions  were  needed  in  the  "TTR,  Form  C"  before  it  could  be  utilized 
to  measure  teacher  effectiveness. 

Perceiving  the  need  to  extend  the  groundwork  laid  by  these  early 
studies,  Stoll  (1971)  undertook  the  construction  and  validation  of  an 
instrument  designed  to  measure  teacher  problem  solving  proficiency 
which  would  feature  improved  reliability  and  validity  and  would  also 
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have  an  equivalent  fonn  available.    Her  aim  was  to  construct  an  instru- 
ment for  the  purpose  of  differentiating  teacher's  problem  solving  pro- 
ficiency on  reading  instruction  related  tasks  overall,  and  to  include 
a  diagnostic  character  to  the  instrument  such  that  subskill  areas  of 
strength  and  weakness  could  be  identified  as  an  aid  to  future  assess- 
ment and  planning  of  instructional  experiences  for  reading  teachers  at 
both  the  individual  and  institutional  levels. 

Her  instrument  consisted  of  nine  subtest  sections  selected  to 
represent  the  content  areas  ".  .  .  considered  by  experts  in  the  field, 
to  be  focal  to  the  teaching  of  reading"  (Stoll,  1971,  p.  24). 

(  Field  testing,  analysis  of  preliminary  results  and  modifications 
yielded  the  instrument  "Problems  in  the  Teaching  of  Reading,  Forms  G 
and  G,  Revised."    The  instrument  was  administered  to  a  population  of 
455  pre-  and  in-service  teachers  with  differing  levels  of  training  and 
experience,  representing  several  universities  and  differing  geographi- 
cal locations.) 

An  attempt  to  overcome  an  earlier  investigation's  shortcomings 
in  scoring  of  responses  was  provided  by  the  use  of  the  criteria  of 
consistency  which  yielded  a  correct  response  that  was  derived  from 
the  problem  information,  processed  according  to  and  consistent  with 
the  rationale  accepted  by  experts  in  the  field  and/or  supported  by 
research. 

Reliability  data  obtained  from  random  samples  of  the  total  study 
population  yielded  a  .96_coefficient  of  equivalence  overall,  with 
subtests  coefficients  ranging  from  a  low  of  .08,  to  four  subtests 
with  coefficients  of  .88  or  higher,  and  lead  to  the  conclusions  that 
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the  instrument  was  both  internally  consistent  and  that  the  alternate 
forms  were  similar. 

/Validity  was  assessed  via  factor  analysis  of  the  subtests  in  the 
instrument  and  via  correlating  subtests  scores  against  measures  of 
I.Q.  and  verbal  aptitude.    Results  indicated  that  the  tests  correlated 
with  intelligence,  but  were  obviously  measuring  something  additional 
and  that  subtests  measures  were  related  but  distinct  in  their  sub- 
skill  assessment./ 

Additional  analysis  indicated  the  instrument  differentiated  over- 
all between  both  the  factors  of  level  of  and  type  of  preparation. 

Considering  the  results  obtained,  Stoll  concluded  that  the  prob- 
lem solving  approach  may  "...  indeed  provide  a  useful  diagnostic 
tool  for  indicating  teacher  weaknesses  in  reading  teaching  skills.  .  .' 
(Stoll,  1971,  p.  105),  and  that  ".  .  .  skill  in  the  areas  tested  by 
this  instrument  can  be  increased  with  training,"  (Stoll,  1971,  p.  100) 
and  further  suggested  that  training  as  by  Powell  (1968)  can  increase 
skill  in  all  areas  tested  by  the  instrument. 

Recognizing  the  potential  of  these  early  efforts  in  the  assess- 
ment of  teacher  competence  (Artly  &  Hardin,  1971;  Stoll,  1971),  Powell 
(1976)  prepared  a  three-stage  model  of  proficiency  in  teaching  read- 
ing and  undertook  an  investigation  to  test  his  model. 

Two  of  the  model's  components— the  acquisition  of  knowledge  and 
transfer/problem  solving— were  proposed  as  being  measurable  via  a 
paper  and  pencil  test  with  the  third  component— util ization  of  know- 
ledge—to be  assessable  via  observation  and  rating  scales. 
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Utilizing  the  instrumentation  available  at  the  time  (Artly  & 
Hardin,  1971)  and  (Stoll,  1971),  he  examined  the  relationship 
between  teacher  knowledge  of  reading  and  the  teacher's  ability  to 
solve  problems  in  reading.    Involving  a  population  of  36  reading 
resource  teachers  with  experience  ranging  "...  from  one  year  to 
many  years  in  teaching,  and  the  level  of  training  varied  from  just 
over  a  bachelor's  degree  to  a  few  with  several  graduate  hours  in  read- 
ing past  the  master's  degree" ({Powell ,  1976,  p.  156),  he  found  a  sig- 
nificant relationship  (R  =  .63  ?  .01)  between  the  total  knowledge  score 
in  reading  and  the  ability  to  solve  classroom  reading  problems.^  Yet 
many  of  the  subtests  correlations  were  low  and/or  not  significant^) 
He  attributed  this  to  the  number  and  type  of  items  in  the  two  instru- 
ments relative  to  the  common  areas  of  focus.    This  interpretation  was 
supported  by  the  results  of  his  factor  analysis  of  the  22  variables 
examined.    The  analysis  revealed  eleven  factors  which  accounted  for 
95  percent  of  the  total  score  variance,  but  only  two  factors  emerged 
from  the  Artly-Hardin  (1971)  "Inventory  of  Teacher  Knowledge  of  Read- 
ing" while  StolTs  (1971)  "Problems  in  the  Teaching  of  Reading"  pro- 
duced eight  identifiable  factors.    This  study's  population  was  con- 
sidered more  homogeneous  than  that  of  Stoll 's  original  work  (1971) 
in  which  only  five  factors  emerged  and  lead  to  the  conclusion  that 
the  "Problems  in  the  Teaching  of  Reading"  had  established  its  power 
of  diagnosis  in  the  areas  measured  and  was  reflecting       .  .  the  sub- 
jects' ability  to  generalize  upon  their  knowledge"  (Powell,  1976,  p. 
158)./ 

Contrary  to  this,  the  Artly-Hardin  "Inventory  of  Teacher  Know- 
ledge of  Reading"  ".  .  .  offers  no  diagnostic  and  prescriptive 
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qualities  ..."  and  "little  in  the  way  of  predictive  power  as  to  who 
will  apply  the  knowledge  they  possess"  (Powell,  1976,  p.  158). 

Yet  the  few  areas  of  similar  focus  between  the  two  tests  do  offer 
.  .  clear  evidence  that  there  is  a  significant  and  marked  relation- 
ship between  the  teacher's  knowledge  in  a  given  performance  area  and 
his/her  ability  to  solve  problems  in  that  area"  (Powell,  1976,  p.  158). 


CHAPTER  III 


METHODOLOGY 

Instrumentation 

The  collection  of  data  for  the  study  was  accomplished  via  two 
instruments  developed  by  the  author.    The  two  tests,  GATER-K  and 
GATER-P,  were  administered  to  subjects  to  obtain  a  measure  of  their 
competency  in  the  knowledge  and  performance  domains  of  teaching  reading. 

Both  instruments  have  as  their  content  basis  the  "Teacher  Compe- 
tencies and  Indicators  for  Learning"  developed  by  Powell  et  al .  (1977). 
Both  instruments  involve  a  pencil  and  paper  format  test  utilizing  a 
machine  scoreable  answer  sheet,  consist  exclusively  of  multiple  choice 
items,  and  both  assess  the  same  set  of  competencies.    The  process  of 
instrument  development  and  validation  was  similar,  although  not  com- 
pletely parallel  nor  concurrent  with  respect  to  time. 

For  the  sake  of  convenience  and  accuracy,  a  historical  perspec- 
tive on  the  instruments'  development  will  be  followed. 
Instrumentation  in  the  Performance  Domain 

In  conjunction  with  an  ongoing  research  grant  for  the  Florida 
Department  of  Education  involving  the  "Project  to  Improve  Education 
in  the  Basic  Skills,"  the  present  author  was  commissioned  to  develop 
a  set  of  items  to  assess  teacher  competence  in  the  performance  domain 
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for  nine  of  the  fiteen  teacher  competencies  identified  by  Powell  et 
al.  (1977). 

The  task  involved  reviewing  the  utilization  of  the  problem  solv- 
ing concept  as  previously  developed  by  Turner  and  Fattu  (1961),  Wade 
(1960),  Burnett  (1961),  and  Stoll  (1971).    From  this  review  a  format 
was  established  for  the  assessment  of  the  performance  domain.  The 
format  casts  the  examiner  in  the  role  of  a  teacher  of  reading.  For 
each  area  assessed,  a  set  of  directions  is  provided,  and  a  context 
established  wherein  the  teacher  is  confronted  with  situations  typical 
of  those  found  in  actual  classroom  settings.    In  selecting  an  answer 
from  the  available  alternatives,  the  subject  must  analyze  and  process 
the  information  provided  in  each  context  to  arrive  at  a  decision. 
The  criterion  for  the  correctness  of  each  decision  is  that  it  must 
be  considered  the  most  appropriate  and  would  be  defensible  according 
to  the  known  and  accepted  knowledge  and/or  theory  in  the  field  of 
reading  instruction. 

To  achieve  content  validity  overall  and  within  each  of  the  compe- 
tencies, the  three  step  approach  recommended  by  Gronlund  (1977)  was 
followed  wherein  for  each  competency  (1)  the  topics  and  outcomes  were 
identified,  (2)  a  table  of  specifications  was  constructed,  and  (3) 
items  for  each  specification  were  developed. 

It  was  anticipated  that  from  this  original  bank  of  items  subse- 
quent field  testing  would  establish  the  differential  strength  of  cer- 
tain items  over  others,  and  the  stronger  items  would  then  be  selected 
for  further  use.    Therefore,  a  criteria  of  between  five  and  ten  items 
per  competency  was  set  to  insure  an  adequate  pool  of  items  for  later 
selection. 
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Each  item,  while  specifically  different  from  each  of  the  other 
items  involving  the  same  competency,  was  designed  to  require  the 
utilization  of  similar  techniques  and  processes  in  order  to  reach 
the  appropriate  decision. 

Also  in  the  course  of  this  process,  it  was  determined  that 
competency  #10,  "Devise  teaching  strategies  for  aiding  students  to 
acquire  a  recognition  vocabulary"  had  two  distinct  parts.    These  two 
parts,  "phonic  analysis"  and  "structural  analysis,"  would  therefore 
be  assessed  in  two  separate  sections,  each  with  its  own  set  of 
directions. 

Utilizing  only  original  material,  a  bank  of  ninety-two  items 
was  developed  and  published  as  a  part  of  ".  .  .  Indicators  of  Teacher 
Performance  in  the  Basic  Skills,  Technical  Report  No.  4,"  Powell  et 
al.  (1978). 

Concurrent  with  this  report,  selected  competency  items  were 
field  tested  in  conjunction  with  teaching  activities  at  the  University 
of  Florida  during  the  Winter  Term,  1978,  and  the  Spring  Term,  1979. 
While  a  problem  with  two  of  the  items  was  detected  during  these 
limited  field  tests,  the  items  as  developed  showed  promise  and  were 
subsequently  committed  to  more  thorough  field  tests. 
Pilot  Study  1 

At  the  conclusion  of  ten  weeks  of  instruction  in  a  basic  course 
in  "Techniques  of  Teaching  Reading"  taught  by  the  present  author,  the 
twenty-four  students  enrolled  were  administered  all  ninety-two  of  the 
performance  domain  items  during  a  two-hour  exam  period.  Their 
responses  were  recorded  on  a  separate  answer  sheet  and  all  items 


22 


were  hand  scored.    Comments  from  the  students  regarding  some  of  the 
items  were  solicited  and  noted. 

Consistent  with  the  results  of  the  preliminary  field  tests,  the 
comments  of  the  students  and  the  results  of  this  study  indicated  that 
two  of  the  items  were  totally  inappropriate  for  further  inclusion. 
These  items  involved  subjects  listening  to  tape  recordings  of  stu- 
dents' oral  reading  to  determine  functional  reading  levels  for  place- 
ment in  reading  materials.    In  both  instances  the  quality  of  the  tape 
recordings  was  unacceptable  in  that  they  could  yield  different  answers 
depending  upon  the  setting  acoustics  during  different  playbacks.  Thus, 
these  two  items  were  dropped  from  further  analysis. 

Analysis  of  the  remaining  ninety  items  produced  an  overall  reli- 
ability estimate  (KR-20)  of  .94,  with  a  standard  error  of  measure- 
ment of  4.07,  thus  indicating  a  strong  internal  consistency  among  the 
items.    A  split  half  reliability  estimate  was  also  calculated  by 
".  .  .  scoring  the  odd  items  and  even  items  separately  and  then  corre- 
lating the  two  sets  of  scores"  (Gronlund,  1977,  p.  140).    This  procedure 
provides  data  on  the  internal  consistency  of  the  test  and  can  also  be 
used  to  gather  some  indication  of  the  consequent  drop  in  reliability 
expected  when  the  length  of  a  test  is  shortened.    This  produced  an  esti- 
mate of  .89  for  Part  I  and  .91  for  Part  II. 

The  ten  individual  subtests  were  also  subjected  to  an  analysis  of 
reliability.    The  KR-20  estimates  ranged  from  .49  to  .86  and  are  sum- 
marized below. 

Subtest  123456789  10 
KR-20    .49      .59      .73      .53      .86      .85      .88      .80      .83  .84 
The  distribution  of  item  responses,  item  difficulty,  item  discrimina- 
tion index  and  point  biserial  correlation  of  items  to  total  scores  was 
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calculated  for  each  of  the  90  items  included  in  the  above  analysis,  and 
these  data  appear  in  Appendix  C. 

The  results  of  this  analysis  lead  to  the  formation  of  a  forty-five 
item  version  of  the  test,  maintaining  the  original  format  in  all  re- 
spects and  reducing  each  of  the  competencies  by  approximately  50 
percent  of  their  original  number  of  items. 
Pilot  Study  2 

The  now  shortened  performance  instrument  was  then  administered  to 
a  group  of  thirty-three  students  upon  completion  of  a  basic  course  in  ■ 
reading  instruction  taught  by  the  present  author  during  the  Winter 
Term  of  1979.    The  same  procedures  of  analysis  noted  above  were  per- 
formed on  these  data  to  verify  the  integrity  of  this  shortened  version 
of  the  test. 

The  resulting  KR-20  reliability  coefficient  was  .7j,  with  a 
standard  error  of  measurement  of  2.41.    The  coefficients  for  the  ten 
subtests  are  summarized  below. 

Subtest     1        2        3        4        5        6        7        8        9  10 
KR-20       .19     .57     .68    -.03    -.04     .74     .39     .45     .38  .15 
The  distribution  of  item  responses,  item  difficulty,  item  discrimina- 
tion index  and  point  biserial  correlation  of  items  to  total  scores 
was  calculated  for  each  of  the  45  items  and  appears  in  Appendix  C. 

In  some  of  the  subtests  the  drop  in  size  of  the  KR-20  coefficient 
was  larger  than  anticipated  from  the  proportional  reduction  in  the  num- 
ber of  items  per  subtest.    However,  it  should  be  noted  that  a  careful 
review  and  consideration  of  the  content  and  instructional  focus  of  the 
reading  course  completed  by  subjects  prior  to  this  pilot  administration 
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offers  an  explanation  of  the  two  very  small  and  two  small  negative 
reliability  estimates  obtained  for  this  group. 

Gronlund  (1977)  notes  in  his  discussion  of  the  methods  of  deter- 
mining reliability  that  both  the  reliability  coefficient  {KR-20)  and 
the  standard  error  of  the  estimate  require  score  variability.  Like- 
wise he  goes  on  to  point  out  that  despite  numerous  attempts,  no  satis- 
factory method  of  estimating  the  reliability  of  criterion  referenced 
mastery  tests  has  yet  been  proposed.  Both  points  are  germane  to  the 
discussion  of  these  results. 

In  all  four  of  the  subtests  under  discussion  (1,  4,  5,  and  10), 
very  high  mean  scores  on  one  or  more  of  the  items  with  no  more  than 
five  items  involved  in  each  subtest  and/or  subsequently  small  item 
variances  will  result  in  very  low  or  negative  reliability  coefficients 
when  in  actuality  the  consistency  of  subjects'  scores  over  the  items 
is  really  rather  high.    Thus,  this  seeming  contradiction  is  a  result 
of  the  statistical  procedures  used  to  calculate  the  coefficients. 

Also  as  mentioned  earlier,  the  situation,  as  in  this  case,  where- 
in subjects'  instructional  experience  creates  a  high  degree  of  compe- 
tence in  these  tasks  has  the  result  of  transforming  what  would  usually 
be  a  normative  assessment  into  a  criterion-referenced  mastery  subtest 
to  which  the  norm  referenced  reliability  procedures  would  be  inappro- 
priate. 

Therefore,  the  overall  strength  of  the  subtests  and  the  total 
test's  KR-20  coefficient  warranted  confidence  in  the  instrumeni,.  How- 
ever, experience  in  administering  the  instrument  and  comments  from 
several  of  the  student  respondents  lead  to  a  revision  of  the  order  of 
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the  subtests,  and  continued  displeasure  with  the  quality  of  the  tape 
recordings  used  in  Subtest  3  resulted  in  a  rerecording  of  two  of  the 
passages  using  different  children  as  readers  without  changing  the  con- 
tent or  the  resulting  correct  answer  and  the  reediting  and  electronic 
enhancement  of  the  voice  quality  in  the  tape. 

The  resulting  instrument  was  then  named  GATER-P  for  "Generic 
Assessment  of  Teacher  Effectiveness  in  Reading  -  Performance  domain," 
and  it  is  this  form  that  was  utilized  for  the  present  study  and  appears 
in  Appendix  B, 

Instrumentation  in  the  Knowledge  Domain 

Employing  the  definitions  previously  offered,  the  knowledge 
domain  test  was  developed  to  assess  those  facts,  procedures,  rules 
and  generalizations  that  best  and  most  generically  represented  the 
specific  objectives  enumerated  by  Powell  et  al .  (1977)  as  underlying 
the  competencies  in  the  knowledge  domain. 

As  with  the  performance  domain  test,  a  table  of  specifications 
was  developed  whereby  each  of  the  ten  competency  areas  represented 
by  GATER-P  would  have  an  equally  represented  set  of  items  in  the 
knowledge  domain  test.    The  items  themselves  were  drawn  from  a  basic 
bank  of  items  previously  used  in  instruction  and  assessment  of  stu- 
dents enrolled  in  basic  reading  methods  courses.    These  items  were 
modified  as  necessary  to  fit  the  rationale  and  format  of  the  overall 
test  and  in  virtually  all  of  the  competencies  new  items  were  developed 
to  achieve  the  desired  number  of  ten  items  per  competency. 

Subsequent  to  initial  item  selection  and  development,  the  pro- 
posed subtests,  along  with  the  statement  of  the  competency  being 
assessed,  were  reviewed  by  two  independent  experts  in  the  teaching  of 
reading.    The  combined  professional  experience  of  these  two  experts 
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includes  years  of  university  teaching  in  the  field  of  reading  a  multi- 
tude of  professional  articles  and  papers,  and  editorial  and  leadership 
positions  on  several  boards  of  regional,  state,  and  national  reading 
organizations.    Their  review  was  part  of  the  process  of  insuring  the 
overall  content  validity  of  the  items  to  the  objectives,  the  appro- 
priateness of  the  answer  choices  and  correct  answer,  and  the  generic 
character  of  the  knowledge  content  as  representative  of  the  overall 
knowledge  and  practices  in  the  field,  and  freedom  from  bias  favoring 
the  views  of  any  one  school  of  thought  or  institution's  curriculum 
over  another.    As  a  result  of  these  independent  reviews,  many  of  the- 
items  and  two  of  the  subtests  underwent  extensive  alterations  before  ' 
receiving  a  final  clearance. 

After  completing  all  revisions,  the  items  were  then  systematically 
intermingled  among  each  other  in  order  to  evenly  distribute  them  across 
the  whole  of  the  test  and  still  provide  a  convenient  organization  for 
hand  scoring  and  diagnostic  analysis.    The  complete  version  of  the 
resultant  test  was  named  GATER-K  for  "Generic  Assessment  of  Teacher 
Effectiveness  in  Reading,  Knowledge  domain"  and  appears  in  its  com- 
plete form  in  Appendix  B. 

This  test,  unlike  its  performance  domain  counterpart,  received 
no  pilot  testing  before  inclusion  in  the  study.  Therefore,  no  pre- 
liminary estimates  of  its  reliability  are  included  here,  but  appear 
instead  in  Chapter  IV  along  with  the  other  results  of  the  study.  A 
complete  summary  of  the  distribution  of  item  responses,  item  diffi- 
culty, item  discrimination,  and  point  biserial  correlation  of  items 
to  total  test  scores  appears  in  Appendix  C. 
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Populations 

In  addition  to  the  two  groups  of  students  involved  in  the  two 
pilot  test  administrations  previously  described,  one  hundred  forty-four 
subjects  involved  in  some  way  in  reading  education  participated  in  the 
study.    All  subjects  involved  were  either  working  in  the  school  systems 
of  or  attending  college  in  the  State  of  Florida,  but  their  backgrounds, 
training  institutions,  and  levels  of  training  and  experience  were 
diverse. 

Sij<ty  of  the  subjects  were  engaged  in  undergraduate  or  graduate 
coursework  in  reading  instruction  at  five  different  universities  within 
the  State  at  the  time  of  testing.    Eighty-fuyr  subjects  were  practicing 
teachers  with  varying  experience  and  not  all  of  whom  were  involved 
either  presently  or  in  the  past  in  teaching  reading,  but  all  of  whom 
were  participating  in  reading  inservice  at  the  time  of  test  administra- 
tion.   A  listing  of  the  participant  groups  is  given  in  Table  1. 

/In  collecting  data  for  the  study  all  participants  were  asked  to 
record  their  number  of  years  of  teaching  experience  (0-99),  years  of 
experience  teaching  reading  (0-9),  degree  level  (freshman-doctoral), 
field  of  specialization  (major),  and  whether  or  not  they  held  certifi- 
cation in  the  teaching  of  reading.    Data  on  these  factors  are  reported 
in  Appendix  D./ 

One  group  of  college  undergraduates  (n  =  23)  was  utilized  twice 
in  certain  of  the  reliability  comparisons  and  in  the  analyses  involv- 
ing the  pre-  and  posttest  scores. 
Collection  of  Validity  Data 

Having  previously  considered  the  need  to  establish  content 
validity  in  the  development  of  the  two  assessment  instruments  des- 
cribed above,  of  paramount  concern  in  the  collection  and  treatment 
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Table  1 

Description  of  Groups  Comprising  the  Total  Population  of 
Subjects  Tested  During  the  Study 


Preservice  students  enrolled  in  a  basic  reading  methods  course 
(University  of  Florida),  tested  prior  to  instruction  23 

The  same  preservice  students  described  above,  tested  upon  com- 
pletion of  ten  weeks  instruction  23 

Graduate  students  enrolled  in  a  reading  seminar  focusing  on 

theory  and  research,  after  completing  six  or  more  courses  in 

reading  instruction  09 

Teachers  from  Pasco  County,  Florida,  currently  teaching  reading 

in  an  elementary  school  with  experience  in  teaching  reading 

ranging  from  two  to  nine  plus  years  07 

Graduate  students  at  the  University  of  Tampa,  Florida,  enrolled 

in  a  course  in  diagnosis  of  reading  skills  after  completing  at 

least  two  previous  courses  in  reading  08 

Undergraduate  seniors  majoring  in  elementary  education  at  the 

University  of  South  Florida  who  were  tested  upon  completion 

of  their  second  course  in  reading  methods  14 

Undergraduate  and  graduate  students  taking  a  course  in  clinical 
remediation  at  Jacksonville  University,  with  at  least  one  prior 
course  in  reading  and  no  experience  in  teaching  reading  06 

Title  I  reading  teachers  from  Alachua  and  Duval  Counties, 

Florida,  who  possess  reading  certification  and  varying 

experience  in  teaching  reading  08 

Practicing  teachers  from  Duval  County,  Florida,  with  varying 

levels  of  experience  and  training  who  were  participating  in 

the  District's  reading  inservice  program  55 


Practicing  teachers  from  Clay  County,  Florida,  enrolled  in  a 

content  area  inservice  reading  course  tested  prior  to  instruction. .14 
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of  data  in  the  study  was  the  need  to  explore  the  issues  of  construct 

and  criterion  validity. 

The  former  according  to  Gronlund  (1977)  centers  around  the  ability 

of  test  performance  to  be  explained  in  terms  of  certain  psychological 

attributes.    In  the  present  study  these  attributes  would  take  the  form 

of  knowledges  and  decision  strategies  in  the  teaching  of  reading. 

Further,  the  study  theorized  that  both  of  these  attributes  were  related 

to  the  variables  of  professional  training  and  experience  in  teaching 

reading;  and  specifically  that  there  might  be  an  interaction  of  these 

variables  that  would  be  reflected  in  differences  in  subject's  test 

scores,  once  it  had  been  established  that  each  of  the  two  tests  was 

capable  of  measuring  a  difference  in  subjects'  level  of  competency. 

Validity  Study  I  -  Differences  in  Tests'  Scores  Attributable  to 

Instruction 

A  portion  of  the  population  included  in  the  overall  study  was 
twenty- three  students  enrolled  in  a  basic  course  in  "Techniques  of 
Teaching  Reading"  at  the  University  of  Florida  during  the  summer  of 
1979.    The  content  of  this  particular  course  was  essentially  the  same 
as  that  of  the  course  under  which  the  pilot  testing  of  the  perfor- 
mance instrument  was  conducted  and  the  curriculum  was  specifically 
consistent  with  the  objectives  and  competencies  to  be  measured  by  the 
two  tests. 

This  course  met  for  two  hours, twice  a  week, for  ten  weeks.  The 
pretest  v;as  administered  during  the  first  class  meeting  and  the  post- 
test  was  given  during  a  class  period  during  the  tenth  week  of  the 
term.    While  generally  familiar  with  the  focus  of  this  study,  the 
course's  instructor  had  no  opportunity  to  review  any  of  the  items  on 
the  tests  until  after  the  posttesting   session  was  completed. 
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Of  the  twenty-seven  students  attending  at  the  pretesting  class 
session,  twenty-three  of  the  same  students  were  also  present  for  the 
posttesting  session,  and  an  additional  five  students  took  the  post- 
test  but  had  no  pretest  scores.    Only  the  twenty-three  students  with 
both  a  pretest  and  a  posttest  score  were  included. 

The  raw  scores  on  the  pre-  and  posttests  were  then  subtracted 
from  each  other  for  both  instruments    GATER-K   and    GATER-P   and  a 
t-test  was  performed  on  the  mean  differences  of  the  scores.    A  failure 
to  detect  a  significant  difference  in  the  pre  and  posttest  means 
would  place  confidence  in  the  instruments'  content  and  construct 
validity  in  jeopardy. 

Validity  Study  II  -  Differences  in  Tests'  Scores  Attributable  to 

Differences  in  Training  and  Experience 

The  second  theoretical  construct  at  issue  in  the  study,  and  the 
one  of  paramount  importance,  was  the  hypothetical  contributions  of 
the  variables  of  training  and  experience  to  the  teachers'  overall 
level  of  competence  in  both  the  knowledge  and  performance  domains. 

At  issue  here  is  the  importance  of  these  two  elements  and/or 
their  interaction  in  the  professional  life  of  a  reading  teacher  with 
regard  to  the  generic  competencies  necessary  to  effective  instruction. 

For  this  portion  of  the  study,  the  entire  population  of  subjects 
reported  earlier  was  included.    For  the  group  of  subjects  involved 
in  Validity  Study  I,  reported  above,  only  the  scores  obtained  on 
their  posttest  were  included. 

The  resulting  one  hundred  and  forty-four  teachers  were  asked  to 
encode  on  their  answer  sheets  information  regarding  their  experience 
in  teaching  reading,  the  number  of  reading  courses  completed  and  their 
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major  area  of  certification,  with  certification  in  reading  being  a 
classification  that  superseded  all  other  certifications. 

A  combination  of  theoretical  and  statistical  concerns  interplayed 
to  arrive  at  a  set  of  levels  for  each  of  the  variables  of  training  and 
experience.    The  intent  was  to  permit  the  examination  of  differences  in 
competency  levels  during  the  early  stages  of  professional  development 
and  monitor  competence  levels  over  a  reasonable  time.    An  additional 
concern  was  that  each  level  should  contain  an  adequate  number  of  sub- 
jects to  render  statistical  analysis  possible  and  meaningful. 

While  many  different  combinations  of  levels  could  have  been 
established,  and  results  might  be  different  under  different  combina- 
tions, the  study's  originally  proposed  set  of  levels  was  maintained 
throughout  the  statistical  analysis. 

For  the  variable  of  training,  subjects  were  grouped  into  cate- 
gories according  to  the  following  criteria:    level  "zero"  contained 
subjects  with  no  prior  training  in  reading  instruction;  level  "one" 
contained  subjects  with  one  course  completed  or  nearly  completed  at 
the  time  of  testing;  level  "two"  contained  subjects  with  one  course 
completed  and  a  second  course  completed  or  nearing  completion  and  no 
third  course  started;  level  "three-to-five"  contained  subjects  with 
at  least  three  courses,  but  no  more  than  five  courses  completed  or 
nearing  completion;  level  "six-to-nine-plus"  contained  subjects  who 
had  at  least  six  courses  in  reading  instruction  completed  or  nearing 
completion,  but  without  having  achieved  the  level  of  reading  certifi- 
cation; and  the  final  level  contained  only  those  subjects  who  had 
acquired  certification  to  teach  reading. 
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For  the  variable  experience,  subjects  were  grouped  into  categories 
according  to  the  following  criteria:    Level  "zero-years"  contained 
subjects  who  had  never  taught  reading  and  who  were  not  currently  in- 
volved in  the  teaching  of  reading;  level  "one-to-three-years"  contained 
subjects  who  had  taught  reading  for  one  complete  year  or  were  currently 
teaching  their  first  year  of  reading  (all  were  tested  during  the  second 
semester  of  the  school  year),  and  those  who  had  completed  or  were  com- 
pleting their  second  or  third  year  of  teaching  reading,  but  who  had  not 
begun  their  fourth  or  more  years;  level  "four-to-six-years"  contained 
subjects  who  had  completed  or  were  in  their  fourth  year,  fifth  year, 
or  sixth  year  of  teaching  reading,  but  who  had  not  begun  a  seventh 
year;  level  "seven-to-nine-plus"  contained  subjects  with  more  than 
six  years  of  experience  in  teaching  reading. 

To  explore  the  hypothesis  that  subjects'  mean  scores  in  the  know- 
ledge and  performance  domains,  as  measured  by  GATER-K  and  GATER-P 
respectively,  were  influenced  by  the  level  of  their  training  or  exper- 
ience or  the  interaction  of  these  two  variables,  an  analysis  of  vari- 
ance procedure  was  constructed  and  performed  utilizing  the  General 
Linear  Models  Procedure  provided  for  in  the  Statistical  Analysis  Sys- 
tem (Helwig  &  Council,  1979).    Since  this  procedure  provides  informa- 
tion only  on  whether  the  means  of  the  subjects  at  the  different  levels 
of  these  variables  differ  significantly  from  each  other,  and  not  on 
which  means  were  different,  additional  post  hoc  multiple  comparisons 
were  planned  and  conducted  among  the  means  of  variables  whose  results 
on  the  Anova  procedure  indicated  the  presence  of  significant  differ- 
ences in  those  means. 
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Also,  two  decisions  were  made  regarding  the  procedures  to  be  fol- 
lowed in  conducting  these  analyses.    First,  since  the  nature  of  the 
design  prevents  obtaining  an  equal  number  of  subjects  in  all  cells, 
and  since  this  situation  of  unequal  n  necessarily  introduces  a  con- 
founding effect  into  the  analysis,  and  since  the  inclusion  of  each  term 
into  the  solution  equation  costs  power  in  degrees  of  freedom  in  the 
F  test,  each  of  the  three  hypotheses  would  be  tested  separately  and 
hierarchially.    A  failure  to  achieve  a  significance  on  the  interaction 
term  on  the  first  test  would  result  in  a  subsequent  analysis  of  variance 
procedure  excluding  the  interaction  in  order  that  the  variance  attri- 
butable to  the  interaction  could  be  used  in  the  subsequent  F  tests  on 
the  main  effects  variables. 

Secondly,  since  the  situation  of  unequal  n  would  also  affect  the 
outcome  of  the  post  hoc  analysis  of  differences  in  means,  the  compari- 
sons on  cell  means  would  utilize  the  least  squares  procedure.  This 
approach  in  essence  compares  the  values  of  the  cells  means  that  actually 
exist  after  the  variance  due  to  unequal  numbers  of  subjects  in  each 
level  of  the  variable  has  been  extracted  from  the  cells.    It  should  also 
be  noted  that  both  of  the  procedures  outlined  above  were  made  in  the 
interest  of  improving  the  interpretabil ity  of  the  results. 

Validity  Study  III  -  Relationship  of  Subject's  Knowledge  and  Per- 
formance Domain  Scores 

The  third  and  final  hypothesis  to  be  tested  in  the  study  was 
designed  to  assess  the  degree  of  relationship  that  exists  between  the 
two  domains  of  knowledge  and  performance  in  teaching  reading. 

For  the  purposes  of  this  study,  scores  of  the  entire  population, 
again  excluding  the  23  pretest  scores,  on  the  knowledge  domain  instru- 
ment were  used  to  predict  their  scores  in  the  performance  domain. 
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The  practical  reason  for  this  test  was  to  determine  the  degree  of 
variance  that  could  be  attributed  to  subjects'  differing  levels  of 
knowledge  as  opposed  to  the  variance  that  was  explained  by  the  vari- 
ables of  training  and  experience,  and  to  provide  a  validity  coeffi- 
cient that  would  address  the  criterion  related  concern  that  while  both 
tests  should  be  positively  and  significantly  related,  one  test  was  not 
an  equally  good  and  sufficient  substitute  for  the  other  (Gronlund, 
1977). 

In  addition  to  the  F  statistic  computed  to  determine  the  relation- 
ship between  subjects'  scores  on  the  two  tests,  the  Pearson  product- 
moment  correlation  coefficient  (r)  was  computed  to  express  the  degree 
of  relationship  between  subjects'  scores  and  a  corresponding  R  was 
computed  to  provide  an  indication  of  the  amount  of  variance  in  sub- 
jects' performance  scores  that  could  be  explained  by  their  scores  in 
the  knowledge  domain. 

The  results  of  all  statistical  procedures  described  in  this 
chapter  are  reported  and  discussed  in  Chapter  IV. 
Limitations 

Typically,  investigative  studies  are  subject  to  limitations 
arising  out  of  the  real  and  practical  constraints  that  occur  in  the 
operational izing  of  theory.    The  present  study  is  no  exception. 
Therefore,  the  following  limitations  are  noted  and  acknowledged  as 
deserving  of  mention. 

In  selecting  the  final  content  of  the  two  assessment  instruments 
used  herein,  the  present  author  acknowledges  that  despite  all  of  the 
care  and  consideration  that  went  into  their  development,  some 
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potentially  pertinent  cognitive  criteria  are  not  represented,  and 
that  other  possibly  appropriate  performance  situations  and  contexts 
were  omitted.    Although  guided  by  the  Table  of  Teacher  Competencier 
(Powell  et  al.,  1977)  appended  herein,  the  judgement  of  the  author 
prevailed  in  the  construction  of  both  the  cognitive  criteria  items 
and  the  performance  domain  situations. 

While  the  intent  of  the  study  is  to  assess  the  level  of  know- 
ledge and  performance  possessed  by  teachers  of  reading,  for  the 
expressed  purpose  of  ascertaining  the  level  of  competence  in  perfor- 
mance of  the  tasks  of  teaching  reading,  and  the  contributions  that 
knowledge  makes  in  this  development,  there  can  be  no  guarantee  that 
competence  as  measured  herein  will  find  its  way  into  daily  practice 
in  the  practical  environment  of  the  classroom.    But  it  can  be 
asserted  that  all  due  care  was  observed  to  construct  cognitive  items 
that  manifested  both  the  qualities  of  fundamentality  and  culmination 
with  respect  to  knowledges  sampled,  and  all  due  effort  was  extended 
to  create  situational  contexts  for  performance  testing  that  are  both 
credible  and  typical  of  the  actual  decisional  contexts  that  surround 
the  practitioner  in  the  public  schools  today. 

Thus,  while  it  is  not  guaranteed  that  the  level  of  competence 
established  via  the  instrumentation  in  this  study  will  be  or  is 
being  utilized  in  the  public  school  setting,  and  while  no  direct 
validation  of  the  effect  of  the  competence  on  pupils'  reading  develop- 
ment is  attempted,  it  can  be  ascertained  whether  the  prerequisites  to 
effective  instruction  at  two  levels  of  assessment  (cognitive  and  per- 
formance) have  been  achieved. 


36 

/Overall,  general izabil ity  of  results  beyond  the  range  of  the 
study's  population  characteristics  is  acknowledged  to  be  inappropri- 
ate and  highly  tenuous./ 

The  lack  of  significant  differences  among  the  level  of  prepara- 
tion groups  utilized  in  this  study  does  not  categorically  exclude  the 
possible  validity  of  this  construct,  as  differentials  may  exist  at 
levels  not  represented  by  the  grouping  strategies  in  this  study. 

Finally,  the  general izabil ity  with  respect  to  the  outcomes  of 
the  hypothesis  which  seeks  to  investigate  the  relationship  of  know- 
ledge to  performance  in  the  area  of  reading  instruction  (#3)  must  of 
necessity  be  limited  to  the  area  of  reading  instruction  in  general 
and  to  the  competencies  incorporated  into  this  study,  as  partial 
rationale  for  the  study  acknowledges  a  potential  exception  to  this 
basic  construct  of  education,  and  in  any  case  is  obviously  and  prima 
facially  limited  to  the  scope  of  the  contents  and  constructs  included 
herein. 


CHAPTER  IV 


RESULTS  OF  THE  STUDY 

The  study  addressed  itself  to  three  research  hypotheses.  A 
restatement  of  these  hypotheses  is  given  below. 
Hypothesis  1: 

There  is  no  interaction  effect  between  the  levels  of 
subjects'  preparation  and  years  of  experience  in  teaching 
reading  on  their  competency  scores,  as  measured  by  GATER-K 
and  GATER-P,  in  either  the  knowledge  or  performance  domains. 
Hypothesis  2: 

There  are  no  differences  between  the  total  competency 
scores,  as  measured  by  GATER-K  and  GATER-P,  in  either  the 
knowledge  or  performance  domains  of  subjects  at  any  of  the 
levels  of  the  main  effects  variables  of  training  or  exper- 
ience in  teaching  reading. 
Hypothesis  3: 

There  is  no  significant  statistical  relationship  between 
the  levels  of  subjects'  knowledge  in  teaching  reading,  as 
measured  by  GATER-K,  and  their  level  of  performance  in  teach- 
ing reading,  as  measured  by  GATER-P. 

Validity  of  the  Instruments 

As  reported  earlier,  considerable  care  was  taken  in  the  construe 

tion  phase  of  the  instrumentation.    The  instruments'  contents  were 
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based  upon  the  research-supported  generic  competencies  specifications 
developed  by  Powell  et  al.(1977).    A  table  of  specifications  was 
employed  during  item  development  to  insure  an  adequate  and  balanced 
distribution  of  the  items  relative  to  each  competency  measured. 

The  knowledge  domain  test  was  subjected  to  preliminary  field 
testings,  wherein  the  results  were  utilized  in  the  revision  of  the 
test  from  its  original  92  items,  to  the  90  items  used  in  the  first 
pilot  study.    Pilot  Study  One  was  conducted  to  produce  data  on  each 
of  the  90  items  which  would  serve  as  a  basis  for  reducing  the  test 
to  a  45  item  format.    Once  reduced,  this  shortened  and  revised 
instrument  (GATER-P)  was  administered  in  the  second  pilot  study  to 
provide  reliability  data  on  the  total  test  and  each  of  the  10  sub- 
tests. 

The  100-item  knowledge  domain  test  (GATER-K)  was  subjected  to 
a  series  of  expert  reviews  in  its  developmental  stages.    While  no 
pilot  tests  were  performed  on  this  instrument,  these  critiques 
guided  a  series  of  revisions  to  correct  item  and  subtest  deficiencies. 
This  precluded  the  necessity  of  deleting  any  of  the  items. 

Thus,  a  certain  degree  of  assurance  exists  that  both  instruments, 
as  used  in  the  study,  were  valid  with  respect  to  the  content  they 
purported  to  measure. 

However,  another  important  step  in  instrument  validation  involves 
determining  that  an  instrument  can  detect  and  measure  differences  in 
the  competency  levels  of  subjects  that  can  be  anticipated  according 
to  certain  theoretical  constructs.    One  method  of  establishing  this 
aspect  of  validity,  suggested  by  Burnett  (1961),  involved  an  anal- 
ysis of  the  tests'  ability  to  detect  changes  in  groups  of  subjects' 
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scores  whose  level  of  competence  would  be  assumed  to  change  as  a  result 
of  direct  instruction  in  teaching  reading. 

The  analysis  involved  one  set  of  subjects  contained  within  the 
general  population  of  the  study  who  were  drawn  from  a  university 
class  in  "Techniques  of  Teaching  Reading."    Both  instruments  (GATER-K 
and  GATER-P)  were  administered  to  the  group  (n  =  23)  prior  to  and 
upon  completion  of  the  course  of  instruction.    A  t  test  was  performed 
on  the  data  from  these  two  administrations.    Results  indicated  that 
the  differences  in  the  means  for  the  group's  pre-  and  posttest  scores 
were  significant  beyond  the  .01  level.    Table  2  shows  the  mean  score 
comparisons  for  the  group. 

Table  2 

Mean  Differences,  Variances  and  t  Values  for  Subjects' 
Pretest/Posttest  Scores 


Group 

n 

d 

s2 

t 

P 

Knowledge 

23 

32.61 

110.94 

14.84 

.01 

Performance 

23 

3.13 

26.3 

2.92 

.01 

^  Since  significant  differences  in  mean  scores  from  pre-  to  posttest- 
ing  on  both  the  tests  are  shown  to  exist,  the  instruments  GATER-K  and 
GATER-P  have  demonstrated  their  ability  to  detect  growth  in  each  of 
the  domains  that  can  be  attributed  to  instruction. 
Rel iabil ity 


Both  instruments  were  subjected  to  a  Kuder-Richardson  Formula 
(KR-20)  to  obtain  a  measure  of  their  reliability  as  it  relates  to  the 
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internal  consistency  of  the  tests.    Both  domains  and  each  of  the  ten 
subtests  in  each  of  the  domains  were  analyzed  for  their  reliability. 
Most  noticeable  in  the  total  test  (Tot-K  and  Tot-P)  reliability  coef- 
ficients, and  also  apparent  in  the  subtests  (Kl-KlO  and  Pl-PlO),  there 
is  a  predictable  increase  in  the  size  of  the  coefficient  as  the  level 
of  expertise  in  the  subjects  increases.    This  trend  is  supportive  of 
the  expectation  that  consistency  of  accuracy  in  responses  to  the 
items  should  increase  on  a  test  which  is  validly  measuring  its 
intended  topic  as  the  amount  of  training  and  experience  of  the  sub- 
jects tested,  relative  to  the  topic,  increases.    The  results  of  this 
analysis  are  reported  in  Table  3  below  in  terms  of  coefficient  Alpha 
(KR-20)  for  the  following  groups:    23  of  the  students  enrolled  in  a 
basic  reading  course  at  a  university  who  took  the  instruments  as  a 
pretest  (PRE)  and  a  posttest  (POST);  114  teachers  and  students, 
except  those  with  reading  certification  and  the  pre-  posttest  group, 
who  otherwise  constituted  the  majority  of  the  sample  for  the  study 
(OTHER);  144  teachers  and  students  constituting  the  combined  total  of 
subjects  in  the  study,  exclusive  of  the  pretest  scores  (COMB);  and  28 
teachers  who  possess  certification  in  reading  (CERT). 

As  in  Burnett's  (1961)  study,  the  lowest  coefficient  reported 
was  for  the  group  of  pretest  students.    To  validate  Burnett's  sugges- 
tion that  this  type  group  was  responding  in  an  almost  random  manner 
on  their  pretest,  a  _t  test  was  also  performed  for  both  the  Tot-K  and 
Tot-P  means  of  this  group  as  compared  to  the  probability  mean  score 
that  would  be  expected  from  random  responses. 
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Table  3 

Reliability  Coefficients  (KR-20)  for  Groups  of  Subjects 
With  Varying  Levels  of  Training 


Subtest 

Pre 

Post 

Other 

Comb 

v^c  r  L . 

K-1 

.12 

.40 

.16 

.33 

.68 

K-2 

.27 

.58 

-.05 

.01 

.07 

K-3 

-.18 

.26 

.46 

.46 

.46 

K-4 

.33 

.08 

.14 

.31 

.64 

K-5 

.25 

.15 

.21 

.29 

.50 

K-6 

.20 

.12 

-.01 

-.06 

-.11 

K-7 

-.37 

.44 

.54 

.59 

.74 

K-8 

.05 

.60 

.62 

.67 

.80 

K-9 

-.10 

-.26 

-.03 

.01 

.01 

K-10 

-.28 

-.14 

.21 

.27 

.48 

P-1 

-.33 

.54 

.41 

.44 

.56 

P-2 

.40 

-.01 

.32 

.33 

.41 

P-3 

-.55 

.13 

-.02 

.09 

.38 

P-4 

.06 

.45 

.47 

.48 

.42 

P-5 

.38 

.67 

.54 

.56 

.56 

P-6 

.60 

.64 

.61 

.61 

.62 

P-7 

.37 

.04 

.33 

.42 

.56 

P-8 

.37 

.69 

.47 

.47 

.46 

P-9 

.67 

.47 

.73 

.72 

.57 

P-10 

.19 

-.13 

-.02 

.05 

.27 

.28 

.56 

.68 

.78 

.90 

Tot-P 

.63 

.79 

.75 

.78 

.81 
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For  the  purpose  of  this  type  of  comparison,  a  probability  score 
was  calculated  for  each  test  based  on  the  ratio  of  one  correct  response 
per  item  to  the  total  number  of  possible  responses  per  item,  with  the 
assumption  of  item  independence  underlying  this  procedure.  Since 
these  probability  scores  were  computed  theoretically,  with  no  actual 
data  generated,  no  estimate  of  the  probability  variance  was  available. 
However,  since  this  procedure  requires  the  assumption  of  similar  vari- 
ances, the  variance  of  the  subjects'  actual  scores  was  used  as  an 
estimate  of  the  probability  score  variance  in  each  of  the  t^  tests 
performed  in  this  phase  of  the  study. 

/As  is  shown  in  Table  4,  there  is  no  significant  difference  between 
the  pretest  group's  mean  and  the  chance  mean  for  Tot-K.    This  suggests 
that  when  knowledge  is  not  present,  as  in  the  case  of  a  pretest  on  a 
no  previous  coursework  in  reading  group,  that  subjects  have  no  better 
strategy  of  response  than  that  of  guesswork.    The  change  in  response 
strategies  after  access  to  knowledge  is  supported  by  the  results  of 
a  t^  test  performed  in  the  manner  described  above  on  the  group's  post- 
test  scores  versus  the  same  probability  mean.    This  test  yielded  a 
difference  statistic  that  was  significant  beyond  the  p  =  .001.  These 
results  are  summarized  in  Table  5. 

Table  4 

Means,  Variances,  and  t  Values  for  Subjects  in  the  Pretest  Group 
and  the  Probability  Score  for  the  Knowledge  Domain 


Group  n  Mean  s^  t  p 

Pretest  Tot-K         23  24.52  20.17 

.51  .10 

Probability  Tot-K    —  25.00  20.17* 

*Variance  of  Prob-Tot  K  assumed  to  be  equal  to  Variance  of  Pre-Tot  K. 
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Table  5 

Means,  Variances  and  t.  Values  for  Subjects  in  the  Posttest  Group 
and  the  Probability  Score  for  the  Knowledge  Domain 


Group  n  Mean  s  t  p 

Posttest  Tot-K         23  57.13  84.66 

16.75  .001 

Probability  Tot-K     —  25.00  84.66* 

♦Variance  of  Prob  Tot-K  assumed  to  be  equal  to  Variance  of  Post  Tot-K. 

Contrary  to  these  findings,  there  is  a  significant  difference 
(p  =  .001)  between  the  pretest  mean  and  the  chance  mean  on  Tot-P. 
This  suggests  that  when  confronted  with  problem  solving  situations, 
subjects  are  likely  to  employ  a  repertoire  of  skills  that  enhance  the 
likelihood  of  a  correct  response  even  when  their  choices  have  no 
specific  basis  for  verification  as  in  the  pretest  situation.    Table  6 
reports  the  means,  variances,  t  value  and  probability  for  subjects  in 
this  pretest  Tot-P  versus  probability  Tot-P  analysis. 

Table  6 

Means,  Variances  and  t  Values  for  Subjects  in  the  Pretest  Group 
and  the  Probability  Score  for  the  Performance  Domain 


Group  n  Mean 


Pretest  Tot-P        23  22.39  26.34 

6.36  .001 

Probability  Tot-P  —  10.75  26.34* 

♦Variance  of  Prob  Tot-P  assumed  to  be  equal  to  Variance  of  Pre  Tot-P. 


44 


Interaction  of  Training  and  Experience 

The  first  hypothesis  tested  by  the  study  sought  to  investigate  the 
presence  of  an  interaction  of  the  factors  of  level  of  training  in 
teaching  reading  and  the  years  of  experience  in  reading  instruction. 
Both  the  knowledge  and  performance  domains  were  checked  for  this 
effect,  with  subjects  grouped  for  analysis  purposes  into  six  levels 
of  training  and  four  levels  of  experience. 

The  levels  used  were  decided  upon  by  a  consideration  of  sufficient 
n  in  each  cell  created  and  the  need  to  detect  changes  in  subjects  as  a 
result  of  growth  in  competence  during  the  early  phases  of  training  and 
experience  on  the  job,  the  effect  of  completion  of  a  program  of  train- 
ing resulting  in  certification,  and  the  trend  Burnett  (1961)  reported 
wherein  a  drop  in  teachers'  mean  scores  occurs  when  experience  extends 
beyond  three  years. 

An  analysis  of  variance  of  mean  scores  among  the  six  levels  of 
training  and  the  four  levels  of  experience  was  conducted  to  test  the 
hypothesis  that  the  level  of  knowledge  in  teaching  reading  was  a  func- 
tion of  the  interaction  of  the  factors  of  training  and  experience. 
Table  7  reports  the  results  of  this  analysis  which  produced  an  F 
value  for  the  total  knowledge  test  score  (Tot-K)  of  .51  with  p  =  .9. 
The  means  and  variance  for  each  of  the  cells  in  the  research  design 
are  reported  in  Table  8  for  the  variable  Tot-K. 

The  analysis  of  variance  among  the  six  levels  of  training  and  the 
four  levels  of  experience  was  performed  to  test  the  hypothesis  that 
the  level  of  proficiency  in  performing  the  generic  tasks  of  teaching 
reading  was  a  function  of  the  interaction  of  the  factors  of  training 
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Table  7 

Anova  Table  for  the  Variables  of  Training  and  Experience  and  Their 
Interaction  on  the  Knowledge  Domain  Total  Scores 


Source  °^  d  f 

Squares  Square 


Training  1027.73  5  205.55  1.44  .21 

Experience  132.04  3  44.01  .31  .82 

Train*Exp.  794.07  11  72.19  .51  .90 

Error  17232.48  118  146.04 
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and  experience.    Table  9  reports  the  results  of  this  analysis  which 
produced  an  F  for  the  total  performance  test  score  (Tot-P)  of  1.49 
with  p  =  .15.    The  means  and  variances  for  each  of  the  cells  in  the 
research  design  are  reported  in  Table  10  for  the  variable  Tot-P. 

Table  9 

Anova  Table  for  the  Variables  of  Training  and  Experience  and  Their 
Interaction  on  the  Performance  Domain  Total  Scores 


Source 

Sum  of 
Squares 

d.f. 

Mean 
Square 

F 

P 

Training 

470.06 

5 

94.01 

2.89 

.02* 

Experience 

468.58 

3 

156.19 

4.80 

.004* 

Train*Exper. 

531.42 

11 

48.31 

1.49 

.15 

Error 

3781.2 

118 

32.04 

/The  results  reported  in  Tables  7  and  9  above  clearly  indicate 
there  is  not  a  significant  interaction  between  the  variables  of  Tot-K 
or  Tot-P.    However,  there  is  evidence  of  a  widespread  belief  within  the 
profession  that  the  interaction  of  training  and  experience  results  in  a 
higher  level  of  competence  than  does  either  variable  alone./  Such  evi- 
dence exists  in  the  structure  of  teacher's  salary  schedules  where  step 
increments  provide  maximum  benefit  to  those  teachers  who  combine  in- 
creases in  years  of  experience  with  additional  coursework  and/or  degrees. 
The  results  of  this  study  offer  no  evidence  in  support  of  this  belief. 

Since,  as  reported  earlier,  the  strategy  for  conducting  the 
tests  on  the  hypotheses  was  to  be  hierarchial,  with  the  interaction 
tested  first,  and  since  the  tests  of  the  interaction  were  not 
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significant,  no  further  analysis  was  performed  on  these  results,  and 
the  interaction  term  was  deleted  from  the  model  before  a  test  of  the 
main  effects  was  conducted. 

Main  Effects  Variables  on  Knowledge  Scores    .  , . 

Subsequent  to  the  results  reported  above  in  Table  7,  which 
indicated  a  lack  of  significance  in  either  of  the  variables  of  train- 
ing or  experience  in  teaching  reading  with  respect  to  the  explanation 
of  the  variances  of  subjects'  knowledge  domain  scores,  an  analysis 
of  variance  was  performed  on  these  variables  with  the  variable  of 
their  interaction  deleted.    This  procedure  produced  an  F  =  1.98  with 
p  =  .09  for  the  training  variable  and  an  F  =  1.13  with  p  =  .34  for 
the  experience  variable.    The  results  of  this  analysis  are  reported 
in  Table  11 . 

Table  11 

Anova  Table  for  the  Variables  of  Training  and  Experience  as  Main 
Effects  on  the  Knowledge  Domain  Total  Scores 


Source                f"'"  °^             d.f.  F  d 

Squares            ^'  '  Square  P 

Training              1352.29              5  270.46  1.98  .09 

Experience            465.82              3  155.27  1.13  .34 

Error  17661.63  129  136.91 


Table  12  reports  the  means  and  variances  of  subjects'  scores  on 
GATER-K  at  differing  levels  of  training  and  experience  in  teaching 
reading. 
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Table  12 


Means  and  Variances  of  Suhiprtc'  to+,i  c 

for  Each  Leva,       ^iTrWCVZT..-  a'nl  iTe'AtV^'^" 


Level  of  Traim* 


ng 


Mean 


Zero  courses 

9 

49.22 

33.19 

One  course 

33* 

54.06 

118.43 

Two  courses 

35* 

51.14 

42.60 

3  to  5  courses 

28 

50.25 

76.49 

6  to  9+  courses 

n 

47.55 

129.87 

Reading  Certification 

28 

46.82 

372.52 

Level  of  Experience 

n 

Mean 

s2 

Zero  years 

67 

51.22 

89.41 

1  to  3  years 

21 

51.24 

126.89 

4  to  6  years 

18 

50.16 

360.74 

7  to  9+  years 

32 

48.53 

143.29 
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Differences  in  Knowledge  Among  Levels  of  Training 

While  the  interpretabil ity  of  further  statistical  analysis  on 
the  training  variables  as  it  relates  to  subjects'  scores  on  the  know- 
ledge domain  test  is  uncertain,  a  post  hoc  analysis  comparing  the 
levels  of  training  was  performed.    This  analysis,  using  the  least 
sqaures  procedure  previously  mentioned,  utilized  the  means  reported 
in  Table  13. 

Table  13 

Least  Squares  Means  for  Subjects'  Total  Knowledge  Domain  Scores 
for  Each  Level  of  the  Variable  Training 


Level  of  Training 

n 

Least  Squares  Mean 

Zero  courses 

9 

51.79 

One  course 

31 

58.31 

Two  courses 

31 

53.59 

3  to  5  courses 

28 

50.55  ^ 

6  to  9+  courses 

n 

47.33 

Reading  Certification 

28 

45.76 

Differences  were  detected  at  p  =  .05  between  the  subjects  having 
one  course  in  reading  and  those  having  three  to  five  courses,  six  to 
nine  or  more  courses,  and  those  having  reading  certification;  and 
the  subjects  having  two  courses  in  reading  and  the  reading  certifica- 
tion group.    Other  differences  among  levels  were  at  less  than  the 
p  =  .05  level.    These  results  are  reported  in  Table  14. 
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Table  14 


Post  Hoc  Comparisons  of  Training  Levels  Via  Least  Squares 
Procedure  for  Estimating  Differences  in  Total  Knowledge  Means 


Level  of 
Training 

0         1  2 

3  -  5 

6  -  9 

Cert. 

0 

6.52  1.80 

-1.24 

-4.46 

-6.03 

1 

—  -4.72 

-7.76* 

-10.98* 

-12.54* 

2 

-3.04 

-6.26 

-7.78* 

3  -  5 
6  -  9 

-3.22 

-4.78 
-1.56 

*Differences  between  levels'  LS  means  significant  @  p  =  .05. 


The  rather  small  but  positive  t  value  associated  with  the  com- 
parison of  the  difference  between  the  level  of  zero  courses  and  one 
course  in  reading  obtained  from  Table  14  (p  =  .15)  and  the  correspon- 
dingly small  F  of  1.98  with  p  =  .09  reported  in  Table  11  warranted 
further  investigation  as  to  the  adequacy  of  these  nine  subjects  at 
the  zero  training  level  in  representing  the  larger  population  of  sub- 
jects with  no  training  in  the  teaching  of  reading. 
Differences  in  Knowledge  Scores  Among  Selected  Levels  of  Training 

The  ability  of  GATER-K  to  detect  significant  changes  in  subjects' 
mean  scores  resulting  from  exposure  to  instruction  in  teaching  read- 
ing has  been  previously  tested  and  reported  in  Table  4.    However,  the 
deletion  of  the  23  pretest  subjects'  scores  from  the  analysis  dis- 
cussed above  left  only  nine  subjects  in  the  category  of  zero  courses 
in  teaching  reading. 


/An  examination  of  the  population  characteristics  for  this  group 
revealed  that  all  nine  of  these  subjects  had  some  teaching  experience, 
although  not  in  teaching  reading,  /  And  an  examination  of  the  means  of 
the  various  levels  of  training  and  the  means  of  the  pretest  group 
suggested  that  the  scores  of  these  nine  subjects  were  more  like  the 
scores  of  other  subjects  having  the  benefit  of  instruction  in  teach- 
ing reading  than  the  scores  of  the  pretest  group.    This  observation 
suggested  conducting  a  t^ test  to  compare  the  means  of  the  pretest 
group  with  that  of  the  zero  course  level  group.    This  test  produced 
a  t^  of  13.03  with  p  =  .001.    Next,  a  t  test  was  performed  to  compare 
the  nine  zero  course  level  subjects'  mean  with  the  31  subjects  with 
one  course  in  reading  instruction.    This  test  produced  a  t^  of  1.28 
with  p  =  .11.    Table  15  summarized  the  results  of  these  comparisons. 

Table  15 

Means,  Variances  and  t  Values  of  Total  Knowledge  Domain  Scores  for 
Subjects  at  the  Pretest  Level,  Zero  Course  Level, 
and  One  Course  Level  of  Training 


Group 

n 

Mean 

2 

s 

t 

P 

Pretest 

23 

24 

.52 

20.17 

13.03 

.001 

Zero  courses 

9 

49 

.22 

33.19 

1.28 

.11 

One  course 

33 

54 

.06 

118.43 

,  These  tests'  results  indicate  the  possibility  that  the  nine  sub- 
jects representing  the  level  of  zero  training  are  not  representative 
of  a  pre-instructional  group  and  in  fact,  whether  by  virtue  of  teach- 
ing experience  or  some  other  reason,  they  are  more  like  subjects  who 
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have  received  instruction  in  teaching  reading.    This  finding  suggests 
the  need  for  further  study  to  clarify  the  ambiguity  in  the  present 
study's  results. 

Effect  of  Experience  on  Knowledge  Scores 

As  reported  earlier,  the  deletion  of  the  interaction  of  training 
and  experience  from  the  analysis  of  variance  of  the  variable  experi- 
ence on  subjects'  total  knowledge  scores  resulted  in  an  F  =  1.13  with 
p  =  .34  (see  Table  11).    The  small  F  produced  and  the  failure  to 
achieve  the  criterion  p  value  of  .05  indicate  that  years  of  experience 
in  teaching  reading  is  not  by  itself  a  significant  variable  in  explain- 
ing the  differences  in  subjects'  total  knowledge  scores  as  observed 
in  this  study. 

This  result  was  not  surprising  as  there  has  been  no  suggestion 
made  that  experience  alone  is  sufficient  opportunity  for  subjects  to 
acquire  the  specific  knowledges  measured  by  GATER-K,  as  these  have 
been  previously  defined  as  facts,  procedures,  rules,  and  generaliz- 
ations which  must  be  learned  and  stored  in  memory  for  later  use, 
and  are  assumed  to  be  primarily  learned  via  study  and  instruction. 
Main  Effects  Variables  on  Performance  Scores 

/As  reported  in  Table  9  above,  the  factors  of  training  and 
experience  in  teaching  reading  as  main  effects  variables  in  this 
design  were  found  to  be  highly  significant  in  their  explanation  of 
variance  among  the  levels  of  subjects  on  the  performance  domain 
test  (GATER-P),  with  the  variable  training  in  teaching  reading  pro- 
ducing an  F  =  2.89  with  p  =  .02,  and  the  variable  experience  in  teach- 
ing reading  producing  an  F  =  4.80  with  p  =  .004.    Table  16  reports 
the  performance  test  means  and  variances  for  subjects  at  each  of  the 
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levels  of  these  variables.  A  discussion  of  the  differences  among  the 
levels  of  these  variable  is  provided  below. 

Table  16 


Means  and  Variances  of  Subjects'  Total  Scores 
for  Each  Level  of  the  Variables  of  Traini 

in  the 
ng  and 

Performance  Domain 
Experience 

Level  of  Training 

n 

Mean 

Zero  courses 

9 

24.11 

5.86 

One  course 

33* 

24.85 

37.57 

Two  courses 

35* 

26.31 

24.81 

3  to  5  courses 

28 

24.75 

44.34 

6  to  9+  courses 

11 

22.09 

58.09 

Reading  certification 

28 

29.00 

41.19 

Level  of  Experience  n 


Zero  years 

67 

24.41 

32.43 

1  to  3  years 

21 

26.81 

39.26 

4  to  6  years 

18 

28.33 

37.76 

7  to  9+  years 

32 

26.72 

44.92 

Due  to  missing  values  in  the  independent  variable  "experience,"  six 
subjects  (2  at  the  "one  course"  level  and  4  at  the  "two  courses" 
level]  included  in  these  calculations,  were  dropped  from  the  sample 
prior  to  the  calculation  of  the  F  statistic  and  the  least  squares 
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Performance  Differences  Among  the  Levels  of  Training 

Having  determined  that  a  significant  difference  existed  among 
some  of  the  levels  of  the  variable  training,  a  post  hoc  analysis 
was  performed  to  determine  at  which  levels  these  differences  were 
significant  at  p  =  .05. 

The  calculation  of  the  least  square  means  for  each  of  the  levels 
of  training  produced  a  pattern  of  change  between  means  that,  while 
generally  consistent  with  the  results  of  Table  16,  made  the  assess- 
ment of  these  differences  more  accurate  relative  to  the  error  in  the 
prediction  equation.    The  means  used  in  this  least  squares  procedure 
are  reported  in  Table  17,  while  the  results  of  these  comparisons  are 
reported  in  Table  18. 

Table  17 

Least  Squares  Means  for  Subjects'  Total  Performance  Domain  Scores 
for  Each  Level  of  the  Variable  Training 


Level  of  Training 

n 

Least  Squares  Mean 

Zero  courses 

9 

26.86 

One  course 

31 

28.65 

Two  courses 

31 

28.68 

3  to  5  courses 

28 

24.50 

6  to  9+  courses 

n 

21.12 

Reading  certification 

28 

28.02 
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Table  18 


Post  Hoc  Comparisons  of  Training  Levels  Via  Least  Squares  Procedure 
for  Estimating  Differences  in  Total  Performance  Means 


Level  of 
Training 

0 

1 

2  3-5 

6-9+ 

Cert. 

0 

1.78 

1.82  2.36 

-5.73* 

1.16 

1 

.03  -4.15* 

-7.52* 

-.63 

2 

—  -4.18* 

-7.55* 

-.66 

3  -  5 
6  -  9+ 

-3.37 

3.52* 
6.90* 

*Differences  between  levels'  LS  means  significant  (?  p  =  .05. 


While  there  is  an  apparent  increase  in  subjects'  performance 
during  the  beginning  levels  of  coursework  in  reading  instruction,  a 
noticeable  drop  in  performance  occurs  as  subjects  increase  their 
preparation  outside  of  a  certification  yielding  program,  and  a  pre- 
dictable maximum  performance  is  reached  by  those  subjects  possessing 
certification  in  reading  instruction.    The  post  hoc  analysis  reveals 
no  significant  difference  (p  =  .05)  among  the  scores  of  the  nine  sub- 
jects with  no  training,  those  with  one  course,  or  two  courses,  and 
the  reading  certification  group.    Likewise,  the  apparent  differences 
between  these  four  levels  of  training  and  the  levels  of  three-to-five 
courses  and  six-to-nine-plus  courses,  which  are  not  significantly 
different  from  each  other,  are  significant  beyond  the  p  =  .05  level. 

These  results  produced  some  findings  that  warrant  further  dis- 
cussion.   While  it  might  be  expected  that  a  clear  and  consistent 
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increase  in  means  would  parallel  the  increases  in  levels  of  course- 
work,  and  while  it  is  possible  that  these  results  simply  reflect  an 
unexpected  bias  in  the  study  sample,  two  important  considerations  are 
offered  to  explain  the  results'  deviation  from  this  expectation. 
First,  as  noted  in  the  previous  section,  despite  the  modest  gains 
between  the  zero  course  level  group  and  the  one  course  and  two  course 
group  which  are  not  significantly  different,  there  is  reason  to  sus- 
pect that  the  nine  subjects  in  the  zero  course  group  are  not  repre- 
sentative on  a  non-instructed  and  non-experienced  group.  Secondly, 
the  similarity  in  scores  among  the  levels  of  the  one  course  and 
two  course  groups  and  the  reading  certified  groups  suggests  that  as 
with  the  knowledge  scores,  the  majority  of  competence,  as  measured  by 
GATER-P,  is  acquired  in  the  earliest  stage  of  instruction  and  that 
either  little  is  gained  or  little  is  to  be  gained  by  additional  course- 
work  in  reading  instruction.    However,  since  the  reading  certification 
group  is  the  only  group  to  approach  the  predetermined  and  arbitrary 
competency  criteria  of  70  percent  on  GATER-P,  it  is  just  as  likely 
that  there  is  more  to  be  learned  in  subsequent  courses  of  instruction 
that  would  serve  to  enhance  these  competencies,  provided  the  curriculum 
in  those  courses  coincides  with  the  competencies  herein  identified, 
rather  than  more  generalized  or  non-competency  related  matters.  Also 
suggested  by  these  data  is  the  implication  that,  due  to  the  quantita- 
tive strength  of  their  scores,  teachers  charged  with  the  responsibility 
of  initial  instruction  in  reading  be  either  certified  in  reading  or 
have  received  at  least  two  courses  in  reading  instruction  that  are 
part  of  a  program  sequence  leading  to  reading  certification  in  order 
to  increase  the  likelihood  that  their  level  of  competence  would  be 
sufficient  enough  to  warrant  the  expectation  of  their  success. 
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Finally,  the  finding  that  the  scores  for  the  groups  with  three- 
to-five  courses  and  six-to-nine  plus  courses  are  significantly  lower 
than  those  of  all  other  groups  except  the  zero  course  group  is  unex- 
pected but  not  without  several  possible  explanations.    First,  is  the 
possibility  that  mere  coursework  in  reading  instruction  does  not 
necessarily  improve  competency  in  reading  instruction,  insofar  as  is 
measured  by  GATER-P,  unless  it  is  organized  and  sequenced  into  some 
kind  of  meaningful  program  of  study  such  as  a  program  leading  to 
reading  certification.    Of  critical  importance  to  this  explanation 
is  the  lack  of  content  control  in  such  practices,  which  can  easily 
fall  prey  to  important  omissions  and/or  redundancy  in  content  without 
providing  a  cohesive  pattern  of  development.    Equally  plausible, 
especially  considering  the  population  in  this  study,  and  not  at  all 
inconsistent  with  the  explanation  above,  is  the  distinct  likelihood 
that  courses  in  reading  instruction  provided  via  district  inservice 
are  quantitatively  and  qualitatively  different,  and  relative  to  the 
competencies  assessed  herein,  inferior  to  the  more  formal  instruction 
associated  with  university-delivered  coursework  and  programs.  This 
latter  explanation  should  be  given  considerable  weight  as  the  author's 
personal  knowledge  of  the  subjects  included  within  the  study  reveals 
that  the  overwhelming  majority  in  the  groups  under  discussion 
received  reading  instruction  primarily  through  inservice  coursework 
focusing  on  reading  instruction  in  the  content  areas  and  reading 
instruction  designed  to  facilitate  the  implementation  of  district 
adopted  basal  reading  series. 
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Other  explanations  exist  and  should  be  mentioned,  although  no 
basis  of  support  can  be  found  for  this  position  within  the  scope  of 
the  present  study.    The  issue  of  whether  the  area  of  reading  instruc- 
tion attracts  its  fair  share  of  high  quality  postgraduates  into 
advanced  study  or  whether  the  more  capable  students  are  attracted  to 
and  siphoned  off  by  other  speciality  areas  is  one  of  considerable 
importance.    The  possibility  of  the  latter,  along  with  the  practice 
of  bypassing  graduate  school  entrance  requirements  by  those  who  seek 
to  add  new  areas  of  certification  and/or  extend  existing  certification 
by  enrollment  in  a  non-degree  yielding  status,  could  also  account  for 
the  drop  in  mean  scores  in  levels  three-to-five  and  six-to-nine  plus. 
Performance  Differences  Among  the  Levels  of  Experience 

In  the  course  of  testing  the  hypothesis  that  an  interaction  of 
training  and  experience  existed  to  influence  scores  in  the  performance 
domain,  the  variable  of  experience  was  found  to  be  a  significant  con- 
tributor to  the  explanation  of  the  variance  in  subjects'  performance 
scores  (see  Table  9). 

Subsequent  to  this  finding  a  post  hoc  comparison  among  the  means 
of  the  four  experience  levels  was  undertaken  to  determine  which  levels 
of  experience  were  significantly  different  from  the  others  in  terms  of 
subjects'  scores.    As  in  the  procedure  described  previously  involving 
the  training  variable,  variance  in  variables  attributable  to  the 
unequal  number  of  subjects  in  each  of  the  levels  was  partialed  out  of 
the  post  hoc  comparison  tests  by  use  of  the  least  squares  procedure. 
These  adjusted  means  used  for  the  comparisons  are  reported  in  Table 
19.    The  differences  calculated  to  exist  between  these  various  adjus- 
ted means  are  reported  in  Table  20. 
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Table  19 

Least  Squares  Means  for  Subjects'  Total  Performance  Domain  Scores 
for  Each  Level  of  the  Variable  Experience 


Level  of  Experience  n 

Least  Squares  Mean 

Zero  years  67 

22.69 

1  to  3  years  21 

26.58 

4  to  6  years  13 

28.32 

7  to  9+  years  32 

27.62 

Table  20 

Post  Hoc  Comparison  of  Experience 
Procedure  for  Estimating  Differences 

Levels  Via  Least  Squares 
in  Total  Performance  Means 

Level  of  Experience        0  1-3 

4-6  7-9+ 

0     years                  —  -3,89 

*           -5.63*  -4.93* 

1  -  3  years  ...  .1.73  _-,  04 

4-6  years  _g9 

*Differences  between  levels'  LS  means  significant  (3  p  =  .05.  

The  results  above  indicate  that  performance  among  subjects  at  all 
levels  of  experience  are  significantly  distinguishable  from  the  per- 
formance of  those  with  no  experience  in  reading  instruction.  The 
indication  of  the  means  (Table  16  and  19)  that  there  might  be  a  peak 
level  of  experience  relative  to  the  performance  variable  was  not 
confirmed  by  the  analysis  which  found  no  significant  differences  among 
any  of  the  three  levels  of  experience  above  the  zero  experience  level. 
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Thus  it  seems  clear  that  some  actual  experience  in  teaching 
reading  is  important  to  the  acquisition  of  competency  in  the  per- 
formance domain.    However,  while  it  may  be  argued  that  professional 
competence  continues  to  develop  with  the  experience  of  the  practi- 
tioner, no  indication  exists  in  these  results  that  this  growth  is 
appreciably  significant. 

Several  explanations  are  possible.    Perhaps  in  the  settings  in 
which  the  subjects  acquired  their  experiences  there  was  a  limited 
opportunity  to  practice  certain  of  the  competencies.    In  this  case, 
additional  experience  would  serve  only  to  maintain  the  competencies 
already  acquired,  rather  than  serve  to  present  an  expanded  opportun- 
ity to  practice  and  acquire  additional  competencies. 

Another  equally  plausible  explanation  would  be  that  increasing 
expertise  acquired  via  additional  experience  is  of  a  nature  that  is 
not  measured  by  GATER-P.    Since  this  instrument  proposes  only  to 
measure  ten  generic  competencies,  growth  in  other  areas  would  rightly 
not  be  detected  by  the  instrument. 

In  either  case,  no  evidence  exists  in  the  present  data  that 
would  support  one  position  over  the  other.    Rather,  it  is  more 
appropriate  to  simply  reiterate  that  for  the  subjects  in  this  study, 
the  evidence  indicates  the  importance  of  a  year  or  more  of  experience 
in  achieving  competency  in  the  performance  domain,  but  that  no  signifi- 
cant improvement  in  competency  results  from  more  than  one  year  of 
experience  for  the  practitioner. 

One  final  note  should  be  made  regarding  the  results  reported 
above.    In  Burnett's  study  (1961),  he  noted  a  drop  in  the  mean 
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scores  of  subjects  with  more  than  three  years  of  teaching  experience, 
except  those  holding  master's  degrees.    The  present  study  also  noted 
a  decline  in  subjects'  mean  scores,  but  the  present  data  suggest 
this  drop  occurs  in  subjects  with  more  than  seven  years  of  experience. 
While  no  direct  comparison  is  advanced  regarding  these  two  sets  of 
data,  it  is  worthwhile  to  mention  that  the  present  data  confirm  this 
earlier  finding  that  the  tendency  of  the  scores  to  decline  after  a 
certain  level  of  experience  is  not  statistically  significant. 
Relationship  Between  Knowledge  and  Performance 

Completion  of  the  foregoing  analysis,  which  indicated  that  the 
same  variables  were  not  equally  significant  with  respect  to  their 
influence  upon  subjects'  scores  in  both  the  knowledge  and  performance 
domains,  left  the  question  of  the  relationship  between  subjects' 
knowledge  and  performance  abilities  to  be  investigated. 

To  test  this  relationship,  an  analysis  of  variance  procedure  was 
conducted  using  the  subjects'  total  knowledge  score  (Tot-K)  as  the 
independent  variable  and  their  total  performance  score  (Tot-P)  as  the 
dependent  variable.    This  test  produced  an  F  =  25.32  with  p  =  .001. 
The  results  of  this  analysis  are  summarized  in  Table  21. 

While  these  results  clearly  establish  that  a  relationship  exists 

between  the  domains  of  knowledge  and  performance,  the  correlation 

between  the  two  scores  on  the  two  tests  was  .389,  which  results  in  a 
2 

R   of  .15.    Therefore,  while  the  level  of  a  subject's  knowledge  of 
teaching  reading  has  a  significant  influence  on  the  level  of  the 
subject's  performance,  as  measured  by  this  study,  there  are  obviously 
other  variables  which  are  also  influencing  this  relationship.  Since 
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this  study  has  shown  that  the  tests  of  training  and  experience  as 
main  effects  variables  on  the  knowledge  domain  scores  did  not  reach 
the  specified  level  of  significance  (p  =  .05),  but  the  tests  of  these 
variables  did  meet  or  exceed  this  criteria  in  relation  to  the  per- 
formance scores  of  subjects  in  the  study,  an  analysis  of  variance  was 
performed  which  combined  the  variables  of  knowledge  score  (Tot-K), 
training  and  experience  as  contributors  to  the  subjects'  total  per- 
formance.   The  results  of  this  procedure  are  summarized  in  Table  22. 

Table  21 

One  Way  Analysis  of  Variance  Table  for  the  Total  Knowledge  Scores 
as  an  Independent  Variable  on  the  Total  Performance  Scores 


Source 

Sum  of 
Squares 

d.f. 

Mean 
Square 

F  P 

Total -K 

834.69 

1 

834.69 

25.32  .0001 

Error 

4681.29 

142 

32.97 

Table  22 

Anova  Table  Combining  the  Variables  of  Training  and  Experience  With  the 
Total  Knowledge  Scores  of  Subjects  as  a  Covariate  on  the  Subjects' 
Total  Performance  Domain  Scores 

Source 

Sum  of 
Squares 

d.f. 

Mean 
Square 

F  P 

Total -K 

765.12 

1 

765.12 

27.17  .0001 

Training 

563.44 

5 

112.69 

4.00  .002 

Experience 

240.51 

3 

80.17 

2.85  .04 

Error 

3605.03 

128 

28.16 
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The  table  above  establishes  the  collaborative  relationship  of  all 

three  variables  to  the  subjects'  total  performance  score,  but  the 
2 

total  R   for  this  model  is  only  .30.    Therefore,  there  are  obviously 
other  variables  not  included  in  this  design  that  hold  the  potential 
of  providing  significant  explanation  of  the  variances  in  scores  in 
the  performance  domain  of  teaching  reading. 
Trends  in  the  Data 

While  the  mean  scores  of  the  subjects  on  both  the  knowledge  and 
performance  domain  tests  have  been  previously  reported  in  Tables  8, 
10,  12  and  16,  a  more  graphic  portrayal  of  these  data  are  included 
below  along  with  an  analysis  of  their  trends. 

Figure  1  presents  the  results  of  subjects'  mean  scores  in  the 
knowledge  domain  over  time,  which  is  represented  by  both  years  of 
experience  in  teaching  reading  and  the  number  of  courses  in  reading 
instruction.    Two  characteristics  are  observable.    First,  the  majority 
of  knowledge  level  information  about  teaching  reading  (as  measured 
by  GATER-K)  is  acquired  in  very  early  phases  of  professional  prepara- 
tion.   Secondly,  initial  knowledge  appears  to  diminish  over  time, 
even  when  additional  courses  are  taken,  certification  is  attained  or 
experience  in  teaching  reading  increases. 


Figure  1 
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Figure  2  presents  the  results  of  subjects'  mean  scores  in  the 
performance  domain  over  time  as  in  Figure  1  above.    These  data  also 
have  two  observable  characteristics.    First,  unlike  knowledge,  maxi- 
mum performance  level  is  not  reached  in  the  initial  stages  of  either 
variable,  but  advances  gradually  through  repeated  exposures  to  both 
coursework  and  teaching  experience.    Secondly,  this  increase  does  not 
continue  indefinitely,  but  reaches  its  maximum  level  rather  quickly, 
after  which  it  tends  to  decline.    The  noticeable  exception  to  this 
trend  occurs  among  those  subjects  who  have  reading  certification. 
This  group  alone  both  achieves  the  highest  level  of  performance  and 
maintains  the  highest  level  over  time. 

Figure  2 
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Summary 

A  summary  of  these  findings,  some  further  discussion  and  recom- 
mendations for  future  research  are  presented  in  Chapter  V  of  this 
study. 


CHAPTER  V 


SUMMARY  AND  RECOMMENDATIONS 

Restatement  of  the  Problem  and  Hypotheses 

The  primary  purpose  of  the  study  was  to  investigate  the  influence 
of  teacher  training  and  experience  in  teaching  reading  on  the  level  of 
teacher  competency  in  teaching  reading.    Building  upon  and  extending 
the  work  of  previous  researchers,  the  study  sought  to  assess  ten 
specific  competencies  in  both  the  knowledge  and  performance  domains 
and  to  investigate  the  relationship  of  knowledge  as  an  indicator  of 
the  subjects'  overall  competency  in  the  performance  domain. 

Specifically,  the  study  was  designed  to  (a)  investigate  the 
effect  of  training  and  experience  on  teacher  competency  in  teaching 
reading  in  both  the  knowledge  and  performance  domains,  and  (b)  exam- 
ine the  relationship  of  teachers'  overall  knowledge  scores  and  per- 
formance scores  on  the  ten  generic  competencies  assessed. 
Hypotheses 

In  conducting  the  investigation,  three  questions  were  investi- 
gated: 

1.    Is  there  an  interaction  effect  of  level  of  preparation 
(training)  and  years  of  experience  in  teaching  reading 
on  subjects'  competency  scores,  as  measured  by  GATER-K  and 
GATER-P,  in  either  the  knowledge  or  performance  domains? 
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2.  Are  there  main  effects  of  either  training  or  experience 
in  teaching  reading  on  the  competency  scores  of  teachers, 
as  measured  by  GATER-K  and  GATER-P,  in  either  the  know- 
ledge or  performance  domains? 

3.  Is  the  level  of  teachers'  knowledge  in  teaching  reading, 
as  measured  by  GATER-K,  related  to  their  level  of  per- 
formance in  teaching  reading,  as  measured  by  GATER-P? 

Instrumentation 

Utilizing  a  set  of  generic  competency  statements  developed  by 
Powell  et  al.  (1977)  which  identified  the  content  areas  and  corre- 
sponding performance  tasks  considered  essential  to  the  successful 
teaching  of  reading,  two  instruments  were  developed  to  assess  10 
of  the  15  identified  competencies.    These  competency  areas  were  test- 
ing, assessment  of  potential  and  performance,  the  functional  reading 
levels,  skill  pattern  and  profile  analysis,  the  total  reading  program, 
the  directed  reading  lesson,  phonic  analysis  and  structural  analysis 
(separated  for  testing  into  two  parts),  comprehension,  and  readability. 

A  performance  domain  test  consisting  of  92  items  was  developed 
first.    This  test  consisted  of  10  subtest  sections,  each  with  its 
own  directions,  that  presented  a  situational  context  from  which  the 
respondents  were  to  select  the  necessary  information,  process  this 
information  against  their  background  of  training  and/or  experience 
in  reading  instruction  and  arrive  at  the  most  appropriate  decision 
from  the  answer  choices  available.    Results  from  two  pilot  testings 
were  used  to  reduce  this  instrument  to  a  45  item,  reformatted  ver- 
sion named  GATER-P,  which  is  the  version  used  in  this  study. 
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The  knowledge  domain  was  assessed  by  a  100-item  multiple  choice 
instrument  measuring  the  same  10  competencies  as  GATER-P.    This  instru- 
ment, named  GATER-K,  had  no  preliminary  field  tests  performed  and  was, 
therefore,  used  in  its  entirety  in  the  study.    However,  prior  to  use, 
this  instrument  was  reviewed  by  reading  experts  to  certify  that  the 
content  and  format  were  fair  and  unambiguous,  and  that  the  knowledge 
measured  was  representative  of  the  field  of  reading  education  and  that 
the  designated  correct  responses  were  clearly  appropriate  and  correct. 
Methodology 

Two  pilot  studies  were  conducted  on  the  performance  domain  test 
to  provide  preliminary  reliability  data  on  the  instrument.  These 
studies  involved  groups  of  24  and  33  students  enrolled  in  a  basic 
course  of  reading  instruction  taught  by  the  present  author  during 
the  Winter  Terms  of  1978  and  1979,  respectively.    Results  of  the 
first  study  lead  to  the  deletion  of  two  items  from  the  functional 
reading  levels  subtest  due  to  poor  audio  quality  in  the  tape  record- 
ings of  students  reading,  which  yielded  ambiguity  in  the  determination 
of  the  correct  response.    A  reliability  estimate  for  the  remaining  90 
items  was  calculated  to  be  .94. 

^Further  analysis  of  these  data  resulted  in  a  shortened  (45  items) 
version,  whose  overall  reliability  results  from  the  second  pilot 
study  was  .73./  The  results  from  this  second  study  lead  to  some 
reformatting  of  the  order  of  the  subtests  and  an  electronic  enhance- 
ment of  the  tape  recording  used  in  the  functional  reading  levels  sub- 
test. 
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The  construction  of  the  knowledge  domain  test  followed  these 
pilot  studies.    Both  instruments  were  then  assembled  into  a  booklet 
and  photocopy  reproductions  were  made. 

The  population  included  in  the  present  study  consisted  of  a  total 
of  144  students  and  teachers  engaged  at  the  time  of  the  testing  in 
either  preservice  or  inservice  education  in  reading  instruction.  Data 
were  collected  on  the  subjects'  backgrounds  for  both  level  of  training 
and  experience  in  teaching  reading.    Additionally,  from  within  the 
total  population,  a  group  of  23  college  students  was  utilized  twice 
in  certain  of  the  reliability  analyses  to  obtain  comparisons  between 
scores  on  a  pre-  and  posttest  basis. 
Instrument  Validity 

The  data  collected  in  the  study  indicate  that  both  instruments, 
GATER-K  and  GATER-P,  appear  to  provide  a  valid  means  of  assessing 
generic  competencies  in  reading  instruction  in  both  the  knowledge  and 
performance  domains,  respectively.    Both  instruments,  when  adminis- 
tered on  a  pre-  and  posttest  basis,  produced  scores  whose  differences 
were  significant  at  the  p  =  .01  level.    Thus,  the  instruments  demon- 
strated an  ability  to  detect  differences  in  subjects'  competency 
levels  and  appear  to  be  capable  of  detecting  growth  in  these  levels 
that  can  be  directly  attributable  to  instruction  in  teaching  reading. 
Instrument  Reliability 

Both  GATER-K  and  GATER-P  appear  to  possess  a  sufficient  reliabil- 
ity and  sensitivity  to  justify  confidence  in  their  use  in  assessing 
the  overall  level  of  generic  competencies  in  teaching  reading.  Cal- 
culation of  the  overall  test  reliability  produced  KR-20  coefficients 
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of  .78  on  both  instruments  for  the  total  study  population.  Additional 
calculations  involving  subjects  at  differing  levels  of  training  and 
experience  indicate  that  the  degree  of  confidence  in  the  instruments' 
reliability  appears  to  increase  as  a  function  of  the  level  of  exper- 
tise in  the  subjects  being  tested.    For  the  group  of  subjects  posses- 
sing the  highest  degree  of  competency,  those  with  reading  certifica- 
tion, the  reliability  coefficients  for  GATER-K  and  GATER-P  were  .90 
and  .81,  respectively. 
Results  of  the  Hypotheses 

The  variables  of  training  and  experience  in  teaching  reading  do 
not  appear  to  interact  to  directly  influence  the  level  of  teachers' 
competency  in  either  the  knowledge  or  performance  domains  of  reading 
instruction.    Analysis  of  variance  tests  of  subjects'  scores  on  both 
instruments  resulted  in  very  small  F  statistics  for  the  interaction 
of  training  and  experience.    Neither  of  these  statistics  met  the 
criteria  of  p  =  .05  and  therefore  the  interaction  term  was  deleted 
from  further  analysis. 

Neither  of  the  variables  of  training  or  experience  in  teaching 
reading  appear  to  have  a  direct  relationship  to  the  overall  level  of 
knowledge  teachers  possess  about  teaching  reading.    Analysis  of 
variance  tests  of  subjects'  scores  in  the  knowledge  domain  produced 
results  that  failed  to  meet  the  criteria  of  p  =  .05  for  either  of 
the  variables  of  training  or  experience. 

However,  the  variable  of  training,  measured  in  the  number  of 
courses  in  reading  instruction,  produced  a  larger  F  than  did  the 
experience  variable.    In  the  interest  of  research,  a  post  hoc 
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comparison  among  the  six  levels  of  the  training  variable  was  con- 
ducted to  determine  which  of  the  apparent  differences  were  of  statis- 
tical importance.    These  results  revealed  strong  and  significant 
(p  =  .05)  differences  between  subjects  in  the  early  stages  of  train- 
ing (1  or  2  courses);  and  those  subjects  with  no  training,  those  with 
more  than  2  courses  and  those  with  reading  certification.  However, 
these  differences  also  reveal  a  negative  relationship  between  these 
levels  which  suggests  that  the  majority  of  knowledge  in  the  teaching 
of  reading  is  acquired  in  the  first  two  courses  of  instruction. 

Findings  of  this  type  clearly  have  implications  for  curriculum 
design  in  reading  education  preparation  programs.    While  results 
showing  a  small  fluctuation  in  scores  over  the  upper  levels  of 
training  would  be  expected,  in  light  of  the  generic  and  minimal 
nature  of  the  competencies  assessed,  the  consistent  and  dramatic 
drop  in  scores  for  these  levels  raises  question  as  to  the  long 
term  retention  and  recall  of  the  knowledges  included  in  the  prepara- 
tion of  professionals. 

There  are,  however,  some  important  limitations  to  this  generali- 
zation which  also  have  application  to  the  performance  domain  and  will 
be  discussed  more  fully  in  the  following  sections.    These  limitations 
not  withstanding,  further  study  of  the  phenomenon  reported  above  is 
obviously  warranted  before  further  conclusions  can  be  offered.    It  is 
also  recommended  that  future  studies  include  some  data  on  the  rela- 
tionship between  the  curricular  content  of  subjects'  coursework  and 
the  specific  knowledges  assessed. 


/   In  contrast  to  the  results  reported  above  for  the  knowledge 
domain,  the  variable  of  training,  measured  in  the  number  of  courses 
in  reading  instruction,  and  the  variable  of  experience,  measured  in 
the  number  of  years  of  experience  in  teaching  reading  appear  to 
have  influence  on  the  overall  level  of  competence  teachers  possess 
in  performing  the  10  generic  tasks,  measured  by  GATER-P,  all  of 
which  are  considered  to  effect  pupil  progress  in  learning  to  read. 

Analysis  of  variance  results  on  these  two  variables  and  the  sub- 
jects' performance  domain  scores  justified  the  conducting  of  post  hoc 
comparisons  among  the  means  to  determine  where  the  apparent  differ- 
ences differed  statistically  from  each  other.  . 

For  the  variable  training,  the  apparent  increases  in  subjects' 
scores  from  no  training  to  one  course  to  two  courses  were  found  to 
be  insignificant  (p  <  .05).    The  results  also  showed  a  drop  in  scores 
at  level  three-to-five  courses  and  six-to-nine-plus  courses.  Tests 
revealed  that  these  levels  were  statistically  different  from  all 
others.    The  highest  scores  were  found  at  the  reading  certification 
level.    The  scores  at  this  level  were  also  different  from  the  three- 
to-five  and  six-to-nine  level  but  were  not  distinguishable  statis- 
tically from  any  of  the  other  levels,  including  those  with  no-train- 
ing.   Subsequent  investigation  revealed  characteristics  of  the  sub- 
jects in  the  no-training  level  that  raised  serious  question  as  to 
their  representations  of  the  general  population  of  people  with  no 
training  in  reading  instruction./ 

Similar  consideration  of  the  subjects  with  more  than  three 
courses  of  instruction,  but  who  did  not  possess  certification  in 
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reading,  gave  rise  to  several  possible  explanations  for  the  dramatic 
drop  in  scores  recorded  for  these  subjects.    Perhaps  more  is  not 
better,  unless  this  more  in  terms  of  coursework  is  purposeful  and 
planned  according  to  some  structure  such  as  a  program  leading  to 
certification.    Or  perhaps,  since  the  author  is  aware  that  the 
majority  of  subjects  in  the  study  whose  course  work  level  was  from 
three-to-nine  or  more  courses  had  taken  these  courses  primarily 
through  their  district's  inservice  program,  there  exists  the  possi- 
bility that  there  is  a  difference  in  the  quality  of  college  course  ' 
delivered  versus  inservice  training  delivered  instruction.  There 
also  exists  the  possibility  that  there  is  a  difference  in  the 
quality  of  persons  who  choose  college  credit  courses  rather  than  in- 
service  courses,  as  this  difference  related  to  their  ability  to  apply 
their  background  in  reading  instruction  to  the  10  generic  tasks 
studied  herein.    Also  considered  as  a  possiblity,  although  no  specific 
information  currently  exists  to  support  the  position,  is  the  converse 
situation  regarding  the  quality  of  subjects  taking  more  than  just  a 
basic  course  or  two  in  reading  education.    With  the  growing  competi- 
tion for  persons  to  meet  the  job  demands  of  the  various  professions 
and  the  differences  in  income  associated  with  those  professions,  it 
is  possible  that  reading  education  is  not  attracting  the  caliber  of 
students  into  its  advanced  levels  that  it  should.    Perhaps  the  best 
talent  is  being  siphoned  off  by  other  programs  in  education  and/or 
industry.    In  any  case,  future  research  should  consider  one  or  more 
of  the  possibilities  discussed  above  in  an  attempt  to  produce  results 
more  enlightening  than  those  presently  available. 
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The  results  of  the  analysis  of  variance  procedure  on  subjects' 
scores  on  the  performance  instrument  for  the  variable  of  experience 
revealed  that  proficiency  in  performing  the  tasks  of  reading  instruc- 
tion does  appear  to  be  highly  dependent  upon  the  experience  one  has 
in  performing  these  tasks.    The  post  hoc  comparisons  of  subjects' 
scores  at  each  of  the  four  levels  of  training  found  all  of  the  levels 
of  training  to  be  superior  and  statistically  different  from  the  sub- 
jects with  no  experience  in  teaching  reading.    Therefore,  the  impor- 
tance of  actual  experience  in  achieving  a  level  of  competency  in  the 
performance  of  the  professional  tasks  of  reading  instruction  is  sub- 
stantiated.   This  finding  further  supports  the  desirability  of  a 
practicum  or  internship  for  preservice  professionals  in  order  to 
establish  this  degree  of  competency.    However,  since  competency 
appears  to  be  acquired  within  the  first  three  years  of  experience, 
future  studies  should  investigate  changes  in  performance  over  the 
course  of  days,  weeks  or  even  months  in  order  to  determine  more  pre- 
cisely the  length  of  experience  most  subjects  would  need  to  achieve 
the  desired  level  of  competency.    Such  findings  could  provide  much 
useful  information  to  those  charged  with  the  responsibility  for 
designing  programs  of  teacher  preparation  in  reading  education  which 
would  assist  them  in  structuring  and  sequencing  the  number  and  dura- 
tion of  field  experiences  and  internship  activities. 

While  the  analysis  of  variance  procedures  clearly  substantiated 
the  existence  of  a  relationship  between  knowledge  and  performance, 
these  same  results  also  indicated  that  the  assessment  of  the  know- 
ledge domain  alone  is  not  sufficient  to  accurately  validate  that  a 
subject  will  be  able  to  perform  the  tasks  of  reading  instruction., 


Xhe  level  of  subjects'  knowledge  accounts  for  only  15  percent  of  the 
total  variance  in  subjects'  total  performance  scores.    This  finding, 
coupled  with  previous  results,  lead  to  a  test  of  the  combined  vari- 
ables of  knowledge  scores,  levels  of  training,  and  levels  of  experi- 
ence on  the  subjects'  total  performance  scores.    While  in  this  model, 
all  three  variables  were  statistically  significant  (p  =  .05),  their 
combined  effect  accounted  for  less  than  one-third  of  the  total  var- 
iance in  subjects'  performance  scores.    Therefore,  there  appears  to 
be  other  unknown,  but  potentially  important  variables  to  be  consid- 
ered as  having  a  sizable  influence  on  the  competence  of  subjects  in 
performing  the  tasks  of  reading  instruction.    With  these  results  in 
mind,  there  is  clearly  a  need  for  further  research  to  isolate  those 
variables.    Such  findings  would  have  obvious  and  important  implica- 
tions for  the  design  of  curriculum  in  the  field  of  preservice  and 
inservice  reading  education. 

Conclusions  and  Recommendations  • 

Based  on  the  experience  and  results  obtained  from  the  present 
study,  several  conclusions  and  recommendations  seem  warranted. 

First,  the  assessment  instruments  developed  for  and  utilized 
herein,  GATER-K  and  GATER-P,  offer  a  potentially  valid  and  reliable 
means  of  measuring  the  level  of  teacher  competence  in  ten  generic 
areas  of  reading  instruction.    These  instruments  also  have  the  ability 
to  provide  data  on  the  level  of  achievement  associated  with  each  of 
the  ten  competencies  in  both  the  knowledge  and  performance  domains. 
Further,. /they  have  both  demonstrated  an  ability  to  measure  changes 
in  competency  resulting  from  instruction  in  reading  education. 
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These  conclusions  warrant  a  recommendation  for  the  utilization  of 
these  instruments  in  further  research  in  this  area.    The  stability  of 
the  reliability  of  GATER-P  in  its  shortened  form  supports  a  similar 
revision  of  GATER-K  in  order  to  reduce  the  time  needed  for  administra- 
tion. 

The  spiral ing  curriculum  concept  that  relies  upon  the  reciprocal 
effects  of  training  and  experience  to  enhance  expertise  is  subject 
to  serious  question  in  the  field  of  reading  instruction.    While  the 
present  author  does  not  question  the  theoretical  foundation  of  this 
concept,  there  is  serious  doubt  as  to  its  practical  implications. 
There  appears  to  be  no  justification  for  a  belief  that  classroom 
instruction  and  actual  experience  are  combining  to  improve  the  com- 
petence of  reading  educators.    Rather  it  seems  more  likely  that  cur- 
rent practices  in  reading  education  are  effective  in  the  early 
stages  of  training  but  have  failed  to  provide  an  overall  program 
to  improve  teacher  competency  in  teaching  reading  that  builds  upon 
these  initial  offerings.    The  notable  exception  that  reading  certi- 
fied teachers  make  to  this  trend  supports  the  recommendation  that 
offerings  in  reading  education  be  more  structured  along  the  lines 
of  certification  yielding  programs  and  that  this  structure  once 
established  be  enforced  to  insure  a  maximum  improvement  of  compe- 
tency by  those  seeking  to  enroll  in  subsequent  levels  of  training. 

Experience  in  teaching  reading  obviously  contributes  to  the 
acquisition  of  competency  in  performing  the  tasks  of  reading  instruc- 
tion.   However,  the  lack  of  a  continuous,  positive  increase  in  the 
level  of  both  knowledge  and  performance  competence  over  the  range 
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of  experience  levels  suggests  a  need  for  professional  review  and 
refreshment  of  training  and  on-the-job  performance  practices.  It 
is  further  recommended  that  additional  research  be  conducted  which 
focuses  on  the  longitudinal  effects  upon  competence  of  time  on  the 
job  and  away  from  a  formalized  program  of  refresher  instruction. 

Finally,  there  is  a  need  to  investigate  variables  other  than 
the  number  of  courses  taken  and  the  number  of  years  of  experience  in 
teaching  reading  that  contribute    to  the  competency  of  reading  pro- 
fessionals.   Also  in  line  with  this  recommendation  is  a  need  for 
further  information  on  the  content  and  methodology  of  instruction 
that  is  associated  with  reading  education.    While  it  is  not  sug- 
gested that  knowledge  is  not  important  in  the  acquisition  of  pro- 
fessional competence,  it  is  recommended  that  knowledge  alone  not  be 
given  too  much  emphasis  in  the  course  of  formal  education  as  these 
results  clearly  indicate  the  limitations  of  this  element  in  dif- 
ferentiating among  the  various  degrees  of  competence  in  teaching 
reading. 


APPENDIX  A 


GENERIC  COMPETENCE  AND  TABLES  OF  SPECIFICATIONS 

The  Florida  Department  of  Education  "Project  to  Improve  Educa- 
tion in  the  Basic  Skills,  Teacher  Competencies  and  Indicators  for 
Learning,  Technical  Report  No.  3,"  Powell    et  al .  (1977)  specified 
15  generic  competencies,  with  both  a  cognitive  and  performance  dimen- 
sion.   Nine  of  those  competencies  were  selected  for  development  of 
assessment  items  in  both  domains.    (Comptency  10  it  was  decided  had 
two  distinct  parts,  and  each  was  treated  separately.)    Thus,  there 
were  10  separate  subtests  developed  out  of  the  statements  of  Generic 
Competency  objectives  that  follow. 

The  Tables  of  Specifications  that  follow  refer  to  these  10  com- 
petencies and  the  number  of  items  developed  to  assess  each  competency. 
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Appendix  A  (continued) 

GENERIC  COMPETENCIES  ASSESSED  BY  GATER-K 
KNOWLEDGE  DOMAIN 
Diagnosis  and  Prescription: 

1.  Knows  the  difference  between  potential,  performance,  and 
placement  instruments,  and  the  purpose  each  type  serves. 

2.  Knows  the  concepts  of  reading  potential  and  reading  per- 
formance.   Knows  how  to  compute  a  reading  expectancy  level 
by  an  acceptable  technique. 

Knows  acceptable  margins  of  discrepancy  between  potential 
and  performance, 

3.  Knows  the  three  functional  reading  levels:  independent, 
instructional,  and  frustration. 

Knows  what  constitutes  a  significant  error  or  misuse  in 
reading  performance. 

Knows  what  to  listen  for;  what  not  to  listen  for;  and  what 
to  look  for. 

Knows  a  differential  criteria  by  difficulty  level  by  which 
to  make  decisions. 

4.  Recongizes  skill  patterns  or  profiles  of  reading  performance 
as  determined  by  assessment  devices. 

Organization  and  Managment 

5.  Develops  a  rationale  for  instructional  effort  including: 
learning  to  read,  reading  to  learn,  reading  for  doing, 
reading  for  fun,  and  corrective/remedial  reading, 

6.  Develops  a  general  framework  for  teaching  a  reading  lesson. 

--Understands  the  basic  purpose  of  a  reading  lesson. 
--Knows  the  characteristics  of  an  acceptable  reading  lesson. 
—  Knows  the  purpose  of  each  characteristic  and  the  function 
that  each  one  serves. 

Instruction 

lOA.    Knows  and  can  articulate  the  basic  phonic  and  structural 
skills. 

lOB.    Develops  a  framework  for  the  basic  decoding  skills  (phonic 
and  structural ) . 
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Appendix  A  (continued) 

12.    Knows  the  value  of  purpose  setting. 

Knows  items  of  language-based  comprehensions. 

Knows  specific  types  of  psychological -based  comprehension 
skills. 

Knows  value  of  and  techniques  for  framing  good  questions. 

Developed  a  conception  of  the  total  comprehension  area. 

14.    Knows  and  understands  the  problem  of  the  match  between 

reader  competence,  content  factors,  word  difficulty  factors, 
and  sentence  difficulty  factors. 
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Appendix  A  (continued) 

GENERIC  COMPETENCIES  ASSESSED  BY  GATER-P 
PERFORMANCE  DOMIAN 
Diagnosis  and  Prescription 

1.  Administer  properly  the  assessment  of  tests  for  diagnosis 
and  prescription. 

2.  Assess  to  see  if  a  youngster  is  making  progress  commensurate 
with  his/her  ability  (not  necessarily  by  grade  or  age). 

3.  Determine  functional  reading  levels  for  placement  in  read- 
ing material . 

4.  Use  data  from  selected  instruments  in  organizing,  placing, 
and  instructing  students. 

Organization  and  Management 

5.  Implement  a  rationale  into  a  total  classroom  reading  program. 

6.  Conduct  a  directed  reading  lesson  within  an  acceptable  learn- 
ing framework. 

Instruction 

lOA.    Devise  teaching  strategies  for  aiding  students  to  acquire 
a  recognition  vocabulary  (phonic  analysis). 

lOB.    Devise  teaching  strategies  for  aiding  students  to  acquire 
a  recognition  vocabulary  (structural  analysis). 

12.    Monitor  comprehension  development  of  students  by  type  of 
specific  comprehension  skill  and  by  type  of  content  being 
used. 

14.    Evaluate  the  difficulty  level  of  reading  material  used. 
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APPENDIX  B 
GATER-K/P 

GENERIC  ASSESSMENT  OF  TEACHER  EFFECTIVENESS  IN  READING 

KNOWLEDGE  DOMAIN  -  FORM  A 
PERFORMANCE  DOMAIN  -  FORM  B 

(EXPERIMENTAL  EDITION) 


Jeffrey  S.  Weathers 
William  R.  Powell 
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Appendix  B  (continued) 

G  A  T  E  R  -  K 

GENERIC  ASSESSMENT  OF  TEACHER  EFFECTIVENESS  IN  READING 


PART  ONE 
KNOWLEDGE  DOMAIN  -  FORM  A 


DIRECTIONS:  The  following  pages  (1-  )  contain  items  1-100.  These 
items  are  designed  to  assess  the  Knowledge  Domain  that  provides  the 
foundation  of  competence  in  each  of  the  ten  areas  of  teaching  read- 
ing. 

For  each  of  these  itmes,  choose  the  answer  (A-D)  that  best  completes 
each  of  the  numbered  statements,  and  record  your  choices  in  the 
same  numbered  space  on  your  answer  sheet. 

When  you  complete  Part  One,  proceed  immediately  to  Part  Two. 
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Appendix  B  (continued) 

1.  By  using  the  informal  reading  inventory,  the  teacher  of  reading 
can  gain  further  insight  into  the  child's: 

A.  word  attack  skills 

B.  level  of  comprehension 

C.  vocabulary 

D.  all  of  the  above 

2.  The  minimum  margin  of  discrepance  used  to  determine  reading  dis- 
ability for  the  middle  grades  (3-4)  is: 

A.  3  months 

B.  6  months 

C.  9  months 

D.  12  months 

3.  A  child  who  scores  99%  accuracy  in  word  recognition  and  demon- 
strates 92%  comprehension  on  the  initial  oral  reading  of  a  sixth 
grade  reading  passage  would  be  classified  as  operating  at  the: 

A.  capacity  level 

B.  frustration  level 

C.  instructional  level 

D.  independent  level 

4.  A  retarded  reader  shows  evidence  of  greatest  retardation  if  he 
makes  most  of  his  word  recognition  mistakes  in: 

A.  recognition  of  syllables 

B.  word  beginnings 
'  C.    word  middles 

D.    word  endings 

5.  A  total  reading  program  includes  developmental,  recreational,  and 
functional  reading  components  which  are  intended  to  be: 

A.  distinctive  from  one  another  in  goals,  objectives,  and  tech- 
niques 

B.  distinctive  entities,  each  encompassing  different  grade  levels 

C.  overlapping,  although  each  has  its  own  distinctive  features 

D.  overlapping,  although  each  is  designated  for  use  in  different 
grade  levels 

6.  Regarding  the  sequencing  of  instruction  in  the  Directed  Reading 
Lesson,  which  of  the  following  statements  is  true: 

A.  oral  reading  should  precede  silent  reading 

B.  silent  reading  should  precede  oral  reading 

C.  one  child  should  read  orally  while  others  follow  silently 

D.  silent  rereading  helps  students  remember  the  main  ideas 


Appendix  B  (continued) 


7.  Which  of  the  following  best  articulates  the  effect  of  the  phonic 
principle  of  "x": 

A.  "x"  says  /z/  in  the  initial  position 

B.  "x"  says  /ks/  in  the  final  position 

C.  "x"  can  say  /sz/  in  some  words 

D.  all  of  the  above 

8.  A  reader  who  realizes  that  the  unfamiliar  word  "knave"  has  two 
silent  letters  is  making  use  of  a: 

A.  context  clue 

B.  phonic  clue 

C.  semantic  clue 

D.  structural  clue 

9.  The  student  is  more  likely  to  employ  suitable  reading  techniques 
when : 

A.  he  is  skilled  in  the  mechanics  of  reading 

B.  the  sentence  structures  are  simple 

C.  the  purpose  for  reading  is  clear 

D.  the  material  is  within  the  reader's  experience 

10.  Major  differences  in  difficulty  scores  over  the  same  passage 
derived  from  different  readability  formulas  can  be  reconciled 
by  acknowledgement  that: 

A.    formulas  are  necessary  evils  at  this  time 
.  ,    B.    different  formulas  used  different  rules 

'    C.    different  formulas  measure  different  levels  of  comprehension 
D.    human  error  is  always  present  in  the  computations 

11.  When  a  child's  reading  grade  on  a  standardized  reading  test  is 
compared  with  his  reading  grade  placement  on  an  informal  reading 
inventory,  it  will  generally  be  found  that: 

A.  the  two  scores  are  quite  similar 

B.  the  performance  on  the  IRI  yields  a  higher  grade  placement 
score 

C.  the  two  scores  will  be  almost  identical 

D.  the  performance  on  the  standardized  test  results  in  a  higher 
grade  placement  score 

12.  Which  of  the  following  may  not  be  used  to  compute  a  reading 
expectancy? 


A.    IQ  X  MA    B.  2MA  +  CA    C.  IQ  x  G.P.    D.  (yrs.  in  school  x  IQ) + 
1   3  
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Appendix  B  (continued) 


13.  A  good  way  to  evaluate  independent  reading  is: 

A.  to  keep  a  record  of  the  number  of  pages  read 

B.  to  note  the  suitability  of  books  read 

C.  to  occasionally  check  comprehension  of  books  read 

D.  all  of  the  above 

14.  In  general,  it  is  expected  that  a  disabled  reader  will  exhibit 
a  patter  of  reading  abilities: 

A.  that  is  common  and  easily  recognizable 

B.  that  is  less  variable  than  that  of  a  normal  reader 

C.  that  is  more  variable  than  that  of  a  normal  reader 

D.  that  indicates  limitations  in  knowledge  of  word  parts 

15.  Each  of  the  following  is  a  goal  of  the  developmental  reading  pro- 
gram.   Which  is  considered  as  being  the  most  important: 

A.  skill  in  the  mechanics  of  reading 

B.  skill  in  reading  comprehension 

C.  enthusiasm  for  reading 

D.  learning  to  read 

16.  The  main  purpose  of  the  skill  building  step  in  the  Directed  Read- 
ing Lesson  is: 

A.  to  introduce  new  word  attack  skills 

B.  to  develop  vocabulary 

C.  to  practice  various  comprehension  abilities 
.      D.    all  of  the  above 

17.  Which  of  the  following  best  articulates  the  effect  of  the  phonic 
principle  of  "hard  and  soft  c": 

A.  "c"  can  sound  like  /k/  when  followed  by  o,  a,  or  r 

B.  "c"  sounds  like  /s/  when  followed  by  i,  e,  or  y 

C.  "c"  has  no  sound  of  its  own 

D.  all  of  the  above 

18.  A  reader  who  decides  that  the  unfamiliar  word  "frighten"  has  the 
two  syllables  "frigh"  and  "ten"  has  made  us  of  a: 

A.  context  clue 

B.  phonic  clue 

C.  semantic  clue 

D.  structural  clue 
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19.  Reading  in  all  of  the  content  subjects  is  characterized  by  diffi 
culties  resulting  from: 

A.  abbreviation  and  symbol ization 

B.  vocabulary 

C.  lack  of  continuity 

D.  failure  to  reject  irrelevant  facts 

20.  When  the  average  sentence  length  of  two  separate  passages  is  vir 
tually  the  same,  the  factor  of  vocabulary  load  can  be  considered 
in  determining  their  relative  difficulty  by: 

A.  the  amount  of  personal  referents  present 

B.  the  number  of  prepositional  phrases 

C.  the  number  of  polysyllabic  words 

D.  all  of  the  above 

21.  A  fairly  adequate  measure  of  general  grade  level  of  reading  is 
obtained  from: 

A.  a  listening  comprehension  test 

B.  a  group  survey  test 

C.  a  group  diagnostic  test 

D.  all  of  the  above 

22.  Which  of  the  following  terms  are  practically  synonymous: 

A.  achievement,  capacity,  placement 

B.  achievement,  expectancy,  placement 

C.  ability,  performance,  placement 

D.  capacity,  expectancy,  potential 

23.  The  reading  level  at  which  the  individual  is  thwarted  or  baffled 
by  the  vocabulary  and/or  complexity  of  the  language  is  labeled 
as: 

A.  capacity  level 

B.  frustration  level 

C.  instructional  level 

D.  independent  level 

24.  The  following  test  scores  for  a  fifth  grade  student,  Vocabulary 
5.3;  Comprehension  =  4.4;  Average  reading  =  4.8,  indicate  that: 

A.  emphasis  should  be  placed  upon  word  attack  skills 

B.  emphasis  must  be  placed  upon  general  comprehension 

C.  emphasis  must  be  placed  on  word  meanings 

D.  emphasis  must  be  placed  on  building  interest 
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25.  Reading  skills  such  as  locating,  organizing,  and  evaluating  infor- 
mation can  usually  be  taught  best  in: 

A.  basic  reading  instruction 

B.  a  separate  class  in  language 

C.  connection  with  social  studies  and  science 

D.  connection  with  music  and  art 

26.  Each  of  the  following  is  a  step  in  a  Directed  Reading  Lesson; 
which  one  is  intended  to  require  the  greatest  amoung  of  class 
time: 

A.  motivation 

B.  purpose  setting 

C.  skills  and  drills 

D.  transfer 

27.  Which  of  the  following  best  articulates  the  effect  of  the  phonic 
principle  of  the  schwa  sound: 

A.  schwa  usually  occurs  in  an  open  syllable 

B.  schwa  usually  occurs  in  a  closed  syllable 

C.  schwa  only  occurs  in  accented  syllables 

D.  schwa  only  occurs  in  unaccented  syllables 

28.  A  reader  who  scrutinizes  the  position  of  a  "y"  in  an  unfamiliar 
word  before  deciding  on  its  sound,  is  making  use  of  a: 

A.  context  clue 

,    B.  phonic  clue 

'   C.  semantic  clue 

D.  structural  clue 

29.  The  reader's  ability  to  correctly  infer  meaning  from  the  vocabu- 
lary and  expressions  in  a  selection  is  largely  dependent  upon: 

A.  author's  style  of  writing 

B.  purpose  and  attitude 

C.  previous  experience 

D.  ability  to  reason 

30.  The  majority  of  the  readability  procedures  in  use  today  were 
developed  for  use  with  and  have  their  greatest  reliability  on: 

A.  passages  of  50-75  words  in  length 

B.  passages  of  narrative  prose 

C.  passages  from  the  content  fields 

D.  passages  of  5000  or  more  words  in  length 
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31.  The  Metropolitan  Achievement  Test  -  Reading  is: 

A.  a  group  diagnostic  reading  test 

B.  a  group  survey  reading  test 

C.  an  individual  diagnostic  reading  test 

D.  an  individual  survey  reading  test 

32.  Which  of  the  following  terms  are  practically  synonymous: 

A.  achievement,  placement,  potential 

B.  ability,  achievement,  performance 

C.  capacity,  performance,  potential 

D.  performance,  placement,  potential 

33.  A  child  who  scores  94%  accuracy  in  word  recognition  and  demon- 
strates 83%  comprehension  on  the  initial  oral  reading  of  a  third 
grade  reading  passage  would  be  classified  as  operating  in  the: 

A.  capacity  level 

B.  frustration  level 

C.  instructional  level 

D.  independent  level 

34.  The  overanalytical  reader  is  one  who: 

A.  is  critical  of  everything  he  reads 

B.  sounds  out  each  part  of  every  word 

C.  relies  too  much  upon  context  clues 

D.  reads  too  much  into  the  story 

35.  '  Over  which  of  the  following  material  would  the  relationship 

between  rate  and  comprehension  be  most  negatively  related: 

A.  literature 

B.  social  studies 

C.  newspapers 

D.  science 

36.  The  primary  focus  of  the  discussion  step  in  a  Directed  Reading 
Lesson  is  to: 

A.  reread  selected  parts  of  the  story 

B.  exchange  views  on  the  meanings  of  expressions  used  in  the 
story 

C.  develop  the  various  specific  comprehension  skills  around 
the  story 

D.  encourage  further  reading  by  students  interested  in  the  topic 
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37.  Which  of  the  following  best  articulates  the  effect  of  the  phonic 
principle  of  "closed  syllable": 

A.  the  vowel  is  short 

B.  the  vowel  is  long 

C.  the  vowel  is  silent 

D.  the  vowel  says  schwa 

38.  A  reader  who  decides  that  the  unfamiliar  word  "masked"  has  only 
one  syllable  is  making  use  of  a: 

A.  context  clue 

B.  phonic  clue 

C.  semantic  clue 

D.  structural  clue 

39.  The  extraction  of  meaning  that  was  obviously  intended,  but  not 
stated  exemplifies    the  level  of  comprehension: 

A.  evaluative 

B.  inferential 

C.  literal 

D.  reorganizational 

40.  The  cloze  procedure  may  be  used  as  a  means  of  determining: 

A.  phonic  knowledge 

B.  vocabulary  development 

C.  readiness  level 

.    D.    text  suitability 

41.  The  California  Test  of  Mental  Maturity  is: 

A.  a  group  achievement  test 

B.  an  individual  readiness  test 

C.  a  group  intelligence  test 

D.  a  silent  reading  test 

42.  Which  of  the  following  is  the  primary  base  line  criterion  used 
in  judging  the  existence  of  reading  disability: 

A.  mental  age 

B.  chronological  age 

C.  social  age 

D.  achievement  test  grade  score 
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43.  A  child  who  scores  90%  accuracy  in  word  recognition  and  demon- 
strates 50%  comprehension  on  the  initial  oral  reading  of  a 
fourth  grade  reading  passage  would  be  classified  as  having 
reached  his: 

A.  capacity  level 

B.  frustration  level 

C.  instructional  level 

D.  independent  level 

44.  Which  of  the  following  means  of  appraisal  of  reading  growth  is 
most  influential  in  improving  instruction? 

A.  day-to-day  appraisals  by  teachers 

B.  annual  standardized  testing  programs 

C.  periodic  individual  conferences 

D.  weekly  criterion  referenced  testing 

45.  Learning  to  fill  out  forms  and  following  directions  are  examples 
of  skills  belonging  to  which  of  the  following  facets  of  the 
reading  program: 

A.  learning  to  read 

B.  reading  to  learn 

C.  reading  for  doing 

D.  reading  for  fun 

46.  In  the  Directed  Reading  Lesson  strategy,  an  important  first  step 
following  the  initial  silent  reading  of  a  selection  is: 

■  A.  noting  the  vocabulary  used  in  the  story 

B.  reconstructing  the  basic  plot  of  the  selection 

C.  practicing  the  word  analysis  strategies  required  by  the  story 

D.  all  of  the  above 

47.  Which  of  the  following  best  articulates  the  effect  of  the  phonic 
principle  of  "open  syllable:" 

A.  the  vowel  is  short 

B.  the  vowel  is  long 

C.  the  vowel  is  silent 

D.  the  vowel  says  schwa 

48.  When  a  reader  decides  that  the  last  vowel  in  the  unfamiliar  word 
"murder"  is  neither  long  nor  short,  the  reader  is  utilizing  a: 

A.  context  clue 

B.  phonic  clue 

C.  semantic  clue 

D.  structural  clue 
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49.  Comprehension  skill  in  grades  K  through  2  should  be: 

A.  introduced  through  listening  activities 

B.  taught  once  a  week  for  35  minutes 

C.  approached  via  round  robin  oral  reading 

D.  all  of  the  above 

50.  An  average  sentence  length  alone  of  10.5  for  Book  and  10.1  for 
Book  B  would  suggest  that  Book  A  is: 

A.  harder  than  Book  B 

B.  easier  than  Book  B 

C.  about  the  same  as  Book  B 

D.  not  comparable  to  Book  B 

51.  The  Classroom  Reading  Inventory  is: 

A.  a  silent  reading  group  test 

B.  an  individual  diagnostic  test 

C.  a  listening  comprehension  test 

D.  a  general  achievement  test 

52.  In  which  of  the  following  grades  would  you  expect  the  correlation 
coefficients  between  reading  and  intelligence  to  be  the  highest: 

A.  first  grade 

B.  third  grade 

C.  sixth  grade 

D.  very  little  difference  at  any  of  the  levels  above 

53.  'Which  of  the  following  does  not  constitute  a  scorable  error  in  a 

child's  oral  reading  performance: 

A.  says  "the  boy  and  the  girl"  when  the  text  read  "the  boy  and 
girl " 

B.  says  "back"  for  "black" 

C.  says  "new  shoe"  for  "old  shoe,"  then  pauses  and  says  "old 
shoe" 

D.  speeds  up  and  slurs  the  last  phrase  of  the  passage  unintel- 
1 igably 

54.  For  a  class  of  3rd  (3.3)  graders  whose  medium  mental  grade  is 
2,5,  and  ability  in  word  recognition  is  1.7,  their  general  per- 
formance is: 

A.  superior 

B.  average 

C.  below  average 

D.  not  determinable  from  the  data 
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55.  The  best  instruction  in  the  skill  of  locating  information  will: 

A.  make  use  of  the  card  catalogue 

B.  involve  a  task  in  which  several  references  must  be  consulted 

C.  require  the  use  of  the  phone  book  yellow  pages 

D.  make  liberal  use  of  library  aids  and  facilities 

56.  The  main  purpose  of  oral  reading  should  be  to: 

A.  provide  enjoyment  for  or  give  information  to  an  audience 

B.  check  the  comprehension  of  silent  reading 

C.  test  the  pupils'  ability  to  sound  out  words 

D.  develop  the  ability  to  read  rapidly  and  fluently 

57.  Which  of  the  following  best  completes  the  following  rule; 
"Words  are  made  up  of  pronounciation  units  called  .  .  .": 

A.  phonemes,  which  are  the  sounds  of  each  of  the  letters 

B.  phonemes,  which  are  the  sounds  of  each  of  the  groups  of 
letters 

C.  syllables,  which  must  contain  a  vowel  or  vowel  combination 
sound 

D.  syllables,  which  must  contain  both  a  vowel  and  one  or  more 
consonants 

58.  The  reader  who  can  pronounce  the  unfamiliar  word  "retractable" 
by  saying  the  prefix  "re,"  the  root  "tract,"  and  the  suffix 
"able"  is  utilizing  a: 

.    A.  context  clue 

'    B.  phonic  clue 

C.  semantic  clue 

D.  structural  clue 

59.  Which  of  the  following  would  be  the  most  important  goal  of  com- 
prehension development: 

A.  reading  to  evaluate 

B.  reading  to  follow  directions 

C.  reading  to  recall 

D.  reading  to  summarize 

60.  Which  criteria  among  the  following  is  generally  the  most  important 
in  selecting  material  for  classroom  use: 

A.  interest  maturity 

B.  difficulty  level 

C.  specific  type  of  reading  demanded 

D.  illustration  maturity 
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61.  Knowledge  of  the  norms  on  a  test  tells  you: 

A.  where  the  average  person  in  the  class  should  be  in  reading 
abil ity 

B.  the  range  in  reading  ability  to  expect  in  the  class 

C.  which  children  in  the  group  are  not  working  up  to  capacity 

D.  none  of  the  above 

62.  What  is  the  approximate  reading  expectancy  of  a  student  with  a 
chronological  and  actual  grade  placement  of  5.5,  and  an  intelli- 
gence quotient  of  110: 

A.  5.7 

B.  6.1 

C.  6.5 

D.  6.7 

63.  Which  of  the  following  does  not  constitute  a  significant  error 
in  a  child's  oral  reading  performance: 

A.  refuses  to  attempt  to  pronounce  the  word  "requisite" 

B.  says  "began  at  noon"  when  text  says  "began  right  at  noon" 

C.  repeats  the  first  two  words  of  the  first  sentence  of  the 
passage 

D.  says  "blussful"  for  "blissful" 

64.  A  class  of  5th  (5.5)  graders  whose  median  mental  grade  is  5.75, 
and  ability  in  word  recognition  is  5.25,  their  general  perfor- 
mance is: 

A.  superior 

B.  average 

C.  below  average 

D.  not  determinable  from  the  data 

65.  The  reading  of  student  selected  material,  including  comics,  joke 
books,  world  record  books,  etc.,  is  legitimate  as  a  part  of: 

A.  the  developmental  reading  program 

B.  the  recreational  reading  program 

C.  the  remedial  reading  program 

D.  none  of  the  above 

66.  The  use  of  oral  reading  at  sight  as  a  device  for  instruction  in 
the  Directed  Reading  Lesson  is: 

A.  highly  recommended 

B.  justifiable,  if  used  judiciously 

C.  frequently  the  best  method 

D.  justifiable,  rarely,  if  at  all 
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67.  Which  of  the  following  best  articulates  the  effect  of  the  struc- 
tural analysis  principle  of  affixes: 

A.  detach  affixes  before  applying  a  pattern 

B.  detach  affixes  after  applying  a  pattern 

C.  detach  affixes  instead  of  applying  a  pattern 

D.  detach  affixes  only  if  they  change  the  meaning 

68.  The  reader  who  decides  that  the  unfamiliar  word  "cain"  must 
sound  like  the  familiar  word  "cane"  is  making  use  of  a: 

A.  context  clue 

B.  phonic  clue 

C.  semantic  clue 

D.  structural  clue 

69.  Comprehension  ability  in  reading  is  actually  the  ability  to: 

A.  anticipate  outcomes 

B.  restructure  one's  own  experiences 

C.  recall  the  content  of  the  printed  page 

D.  understand  the  author's  words 

70.  Which  of  the  following  readability  formulas  does  not  directly 
incorporate  the  factor  of  average  sentence  length  for  estimating 
the  reading  difficulty  of  books  fourth  grade  and  up: 

A.  McLaughlin  Smog 

B.  Flesch 

.    C.  Dale-Chall 

D.  Harris-Jacobsen 

71.  Norms  on  a  standardized  test: 

A.  may  be  considered  goals  for  achievement 

B.  represent  mediocre  performance 

C.  are  of  little  value  for  comparing  individuals  within  a  class 

D.  are  of  the  greatest  value  to  test  makers  because  they  form 
the  basis  for  developing  test  reliability 

72.  What  is  the  approximate  reading  expectancy  of  a  boy  entering 
eighth  grade  with  a  Stanford-Binet  IQ  of  115: 

A.  8.5 

B.  8.7 

C.  8.9 

D.  9.1 
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73.  According  to  the  classification  system  of  reading  levels  by  Betts, 
the  highest  reading  level  at  which  the  individual  can  read  with 
full  understanding  and  freedom  from  mechanical  difficulties  is  his: 

A.  capacity  level 

B.  frustration  level 

C.  independent  level 

D.  instructional  level 

74.  A  class  of  2nd  (2.4)  graders  whose  median  mental  grade  is  1.90, 
and  ability  in  word  recognition  is  2.1,  their  general  performance 
is: 

A.  superior 

B.  average 

C.  below  average 

D.  not  determinable  from  the  data 

75.  Which  of  the  following  is  a  major  purpose  of  the  recreational 
reading  program: 

A.  to  read  to  learn;  obtaining  information  from  many  types  of 
material 

B.  to  develop  a  positive  attitude  toward  reading,  to  enjoy  and 
appreciate 

C.  to  demonstrate  the  teacher's  interest  in  reading  to  motivate 
pupil s 

D.  to  improve  decoding  and  comprehension  skills  through  trade 
book  reading 

76.  Which  of  the  following  best  defines  the  purpose  of  the  Directed 
•,   Reading  Lesson: 

A.  to  teach  stories  in  basal  readers 

B.  to  present  reading  as  a  problem  solving  activity 

C.  to  encourage  all  pupils  to  think  correctly 

D.  all  of  the  above 

77.  Which  of  the  following  best  articulates  the  effect  of  the  struc- 
tural analysis  principle  of  ?le*:    (*  ?le  means  any  consonant 
followed  by  "le") 

A.  /?le 

B.  ?/le 

C.  ?l/e 

D.  ?le  don't  divide 
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78.  The  reader  who  decides  that  the  unfamiliar  word  "vagrant"  has 
the  two  syllables  "va"  and  "grant"  is  making  use  of  a: 

A.  context  clue 

B.  phonic  clue 

C.  semantic  clue 

D.  structural  clue 

79.  Comprehension  is  controlled  by: 

A.  background  of  experience 

B.  intelligence 

C.  purpose  for  reading 

D.  all  of  the  above 

80.  The  best  informal  assessment  a  teacher  can  use  in  determining 
the  readability  of  one  book  over  another  is  by  the: 

A.  number  of  hard  words 

B.  number  of  prepositional  phrases 

C.  number  of  polysyllabic  words 

D.  number  of  words  in  the  passage 

81.  One  of  the  unique  advantages  of  standardized  tests  is  that: 

A.  they  adequately  cover  the  material  taught 

B.  they  are  used  nationally 

C.  they  provide  norms 

D.  all  of  the  above 

82.  Which  of  the  following  is  not  a  reading  disability  case: 


A. 

Mary: 
grade 

school 
-  3.1 

grade 

-  3.4; 

rdg. 

expectancy 

-  3.9; 

rdg. 

B. 

John: 
grade 

school 
-  5.5 

grade 

-  5.0; 

rdg. 

expectancy 

-  6.7; 

rdg. 

C. 

Joel : 
grade 

school 
-  6.2 

grade 

-  7.5; 

rdg. 

expectancy 

-  5.9; 

rdg. 

D. 

Anne: 

school 

grade 

-  4.6; 

rdg. 

expectancy 

-  3.8; 

rdg. 

grade 

-  3.0 

83.    Which  of  the  following  does  not  constitute  a  significant  symptom 
in  oral  reading  behavior: 

A.  head  movements  while  reading 

B.  twitching  of  the  eye(s)  during  reading 

C.  losing  the  place  while  reading 

D.  occasional  hesitation  before  certain  words 
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84.  Seventy  percent  of  a  sixth  grade  class  is  above  the  mean  reading 
score  given  in  the  table  of  norms  for  sixth  graders: 

A.  you  may  assume  that  the  norms  were  made  on  a  different  sort 
of  group,  different  in  intelligence,  socio-economic  status, 
etc. 

B.  you  may  assume  that  this  school  has  done  a  good  job  of  teach- 
ing reading 

C.  you  need  a  description  of  both  the  group  the  test  was  stan- 
dardized on  and  of  this  group  before  you  can  assume  anything 
about  the  effect  of  the  reading  program  they  received 

D.  none  of  the  above 

85.  The  purpose  of  the  remedial  reading  program  is  to: 

A.  correct  reading  difficulties  before  they  become  serious 

B.  motivate  reluctant  learners  to  "work  hard"  to  avoid  remedi- 
ation 

C.  overcome  major  reading  problems  that  require  special  exper- 
tise 

D.  provide  reading  instruction  for  the  retarded  students  in  the 
school 

86.  The  purpose  setting  step  of  the  Directed  Reading  Lesson  should: 

A.  determine  the  expected  outcome  of  the  reading 

B.  help  students  feel  better  about  why  they  have  to  read 

C.  encourage  students  to  read  other  related  stories 

D.  insure  that  all  pupils  accept  the  need  to  learn  to  read 

87^    Which  of  the  following  best  articulates  the  effect  of  the  struc- 
tural analysis  principle  of  "vcv:" 

A.  /vcv 

B.  v/cv 

C.  vc/v 

D.  vcv  (all  one  syllable) 

88.    The  reader  who  decides  that  the  first  sound  in  the  unfamiliar 
word  "wrought"  is  a  /r/,  is  making  use  of  a: 

A.  context  clue 

B.  phonic  clue 

C.  semantic  clue 

D.  structural  clue 


Appendix  B  (continued) 


89.  Which  type  of  questioning  places  the  greatest  demand  on  the 
respondent  after  reading: 

A.  matching 

B.  multiple  choice 

C.  cued  response 

D.  unaided  recall 

90.  For  a  high  school  student  of  2.0  reading  ability,  which  material 
would  be  most  suitable: 

A.  a  second  grade  basal  reader 

B.  a  reading  skills  text  of  approximately  second  grade  level 

C.  a  fourth  grade  rewrite  of  Sherlock  Holmes 

D.  a  fourth  grade  science  book 

91.  When  you  desire  information  concerning  a  child's  reading  achieve- 
ment level,  you  should  use  which  of  the  following  type  test: 

A.  standardized  survey 

B.  standardized  oral 

C.  individual  diagnostic 

D.  individual  intelligence 

92.  The  following  test  scores  for  a  fifth  grade  student  indicate: 
(Capacity  -  4.2;  Comprehension  -  4.2;  Vocabulary  -  4.9) 

A.  reading  disability 

B.  poor  word  attack  skills 

C.  serious  retardation  in  reading 

D.  adequate  reading  performance  for  his  capacity 

93.  Which  of  the  following  does  not  constitute  a  significant  symptom 
in  oral  reading  behavior: 

A.  holding  the  book  12  to  14  inches  from  the  face 

B.  contorting  the  face  during  reading 

C.  rubbing  the  eyes  while  reading 

D.  speaking  with  a  high  pitched  voice 

94.  Typically,  the  disabled  reader: 

A.  possesses  extreme  physical  deficiencies  or  sensory  defici- 
encies 

B.  is  a  child  with  more  intellectual  ability  than  reading 
abil ity 

C.  is  a  result  of  emotional  disturbance 

D.  is  below  average  in  general  intelligence 


Appendix  B  (continued) 


95.  Remedial  reading  is  best  defined  as: 

A.  a  widely  used  program  of  instruction  for  reading  teachers 

B.  a  part  of  the  regular  classroom  reading  instruction  that  is 
adapted  to  the  specific  difficulties  of  the  students 

C.  a  method  of  improving  the  reading  of  all  those  children  not 
reading  up  to  their  actual  grade  level 

D.  teaching  by  the  specialist,  outside  the  regular  classroom, 
for  students  with  significant  discrepancies  between  poten- 
tial and  performance 

96.  An  important  prereading  step  in  the  Directed  Reading  Lesson  is: 

A.  building  background,  interest  and  motivation 

B.  presenting  new  or  different  vocabulary 

C.  providing  guidance  and  setting  a  purpose 

D.  all  of  the  above 

97.  Which  of  the  following  best  articulates  the  effect  of  the  struc- 
tural analysis  principle  of  "vccv": 

A.  v/ccv 

B.  vc/cv 

C.  vcc/v 

D.  vccv  Cdon't  divide) 

98.  The  reader  who  decides  that  the  "y"  is  the  final  syllable  in  the 
unfamiliar  words  "roxy,  levy,  and  sicky"  is  making  use  of  a: 

A.  context  clue 

:  B.  phonic  clue 

C.  semantic  clue 

D.  structural  clue 

99.  The  recommended  strategy  for  developing  higher  level  comprehensii 
skills  requires  that  questioning  and  discussion: 

A.  be  built  upon  a  solid  factual  base  of  information  from  the 
story 

B.  always  begin  by  answering  the  purpose  setting  question 

C.  initially  establishes  the  reader(s)  emotional  reaction  to 
the  passage 

D.  consists  exclusively  of  evaluative  level  inquiries  and 
responses 


Appendix  B  (continued) 


100.    Which  of  the  following  readability  formulas  is  designed 

exclusively  for  estimating  reading  difficulty  of  a  book  at 
the  primary  level : 


A.  Fry 

B.  RIDE 

C.  Fog  Index 

D.  Spache 
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G  A  T  E  R  -  P 

GENERIC  ASSESSMENT  OF  TEACHER  EFFECTIVENESS  IN  READING 


PART  TWO 
PERFORMANCE  DOMAIN  -  FORM  B 


DIRECTIONS:    The  following  pages  (19-34)  contain  items  101-145.  These 
items  are  designed  to  assess  the  Performance  Domain  that  represents 
your  decision  making  competence  in  each  of  the  ten  areas  of  teaching 
reading. 

For  each  of  these  areas,  read  the  printed  directions  at  the  beginning 
of  each  section.    Determine  your  answer  and  record  your  choices  in  the 
same  numbered  space  001-145)  on  your  answer  sheet. 

When  you  complete  Part  Two,  you  may  use  any  remainina  time  to  check 
over  your  answers  in  Part  Two  of  the  test.    Do  not  go  back  to  Part 
One  after  you  have  begun  work  on  Part  Two.  ~ 
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Appendix  B  (continued) 


Objective  #5     Implement  a  rational  into  a  total  classroom  reading  program 

Directions:    Below  are  listed    5    distinctive  types  of  reading  activity.    Below  these 
are  a  series  of  sceneriors,  typical  of  efforts  to  implement  this  rationale 
into  the  classroom. 


Read  each  of  the  scenerios  carefully.    Then  determine  which  of  the    5  types 
of  reading  activity  is  being  served  by  each  of  the  scenerios.    Label  each 
scenerio  with  the  letter  of  the  activity  (A-E)  you've  selected.    Each  activ- 
ity may  be  used  once,  more  than  once,  or  not  at  all. 


Reading  Activities 

A.  Content:    acquiring  academic  knowledge/book  learning 

B.  Recreational:    extensive  reading,  with  seeking  and  self-selection 

C.  Retrieval:    recovering  and  utilizing  information/task  completing 

D.  Corrective:    balancing  of  reading  patterns 

E.  Remedial:    revitalizing  specific  dysfunctions/deficiency  curing 


Scenerios 


101.  Mr.  W,  the  reading  specialist,  agrees  to  test  Merle  who  is  several  years  below  the 
rest  of  the  class  in  reading  and  makes  provision  to  work  individually  with  Merle 
during  the  classes'  daily  reading  time.    He  also  calls  a  parent  conference  to  dis- 
cuss outside  tutoring. 

102.  Ms.  F  provides  ten  minutes  of  class  time  three  days  per  week  for  students  to  check 
out  and  return  library  books,  and  she  also  sets  aside  the  last  30  minutes  of  the 
day  on  Tuesdays  and  Fridays  for  her  students  to  read.    No  passes,  writing,  talking, 
or  movement  is  permitted  during  these  times. 

103.  Mr.  M  prepares  a  class  chart  reporting  the  subtest  scores  from  the  last  county-wide 
testing.    Looking  it  over  he  notices  that  several  students  who  are  generally  adequate- 
to-good  readers  have  one  to  two  skill  areas  where  an  obvious  weakness  is  evident. 
Responding  to  this,  Mr.  M  arranges  to  group  his  class  for  skill  work  and  prepares 
materials  that  will  focus  on  the  areas  of  weakness  for  the  groups.    Those  students 
without  specific  weakness  areas  are  grouped  together  for  more  general  kinds  of 
skills  activity. 

104.  Mr.  G  has  had  his  class  keep  daily  records  of  their  work  in  the  areas  of  vocabulary, 
comprehension,  and  word-attack-skills  activities.    He  has  prepared  a  progress  report 
form  to  be  sent  out  with  the  six  weeks  report  cards.    He  had  included  in  his  progress 
report  packet,  a  set  of  simple  directions  explaining  what  information  is  to  go  in 
what  blanks  on  the  form.    He  has  instructed  students  to  use  the  directions  and  the 
records  of  their  work  to  complete  the  form.    He  plans  to  personally  check  the 
accuracy  of  the  reports  before  sending  them  home. 

105.  Ms.  H  teaches  social  studies  and  reading  to  sixth  grade  students.    She  has  selected 
two  sets  of  books  on  Florida  History,  and  grouped  students  according  to  their  reading 
levels.    The  students  are  to  read  the  designated  chapters  from  the  book  assigned  to 
learn  about  Florida's  role  in  the  Civil  War.    She  plans  to  provide  in-class  reading 
time  and  frequent  discussions  over  the  next  two  weeks  to  prepare  students  for  a  unit 
test. 
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Appendix  B  (continued) 


Objective  6 

Conduct  a  directed  reading  lesson  within  an  acceptable  learning  framework. 


Directions:    Below  are  listed  five  characteristics  with  accompanying  definitions  that 
are  considered  to  be  essential  to  the  successful  delivery  of  a  directed 
reading  lesson, 

Below  these  are  excerpts  typical  of  those  that  are  provided  in  the 
teachers'  guidebook  of  many  popular  basal  series. 

Read  the  guidebook  excerpts  carefully  and  determine  which  of  the  five 
elements  is  most  adequately  accomplished  through  this  activity.  Label 
each  excerpt  with  the  letter  of  the  element  (A-E)  you've  selected. 
Each  element  may  be  used  once,  more  than  once,  or  not  at  all, 


Elements 

A.  ■  Transfer 

B.  Purpose:    providing  a  reason  or  reasons  for  reading  the  selection 

C.  Establishing  background  information:    relating  pupils'  experiences  and  concepts 
to  ideas  which  are  presented  in  the  story 

D.  Skills  and  drills:    extending  skills  in  word  attack,  sight  vocabulary,  compre- 
hension  and  vocabul ary 

E.  Vocabulary  introduction:    presenting  meaning  and  pronunciation  for  words  in 
the  story  which  children  are  meeting  for  the  first  time(s)  in  print 


Guidebook  Suggestions 

106.  Invite  pupils  to  share  with  the  class  some  of  their  experiences  with  shadows 
and  dreams  of  creatures  that  they  use  to  think  lurked  in  their  bedroom.  Ask 
if  they  tended  to  see  these  all  of  the  time  or  just  at  certain  times? 

107.  Write  the  words  "giraffe,"  "lurked,"  "elusive,"  "drowsy,"  and  "woozy"  on  the 
chalkboard  or  overhead  in  the  context  of  sentences  or  phrases.  Select  students 
to  read  these  aloud.    Ask  for  context  definitions  and  to  use  the  words  in  a 
sentence. 

108.  Instruct  students  to  read  this  story  for  fun  and  pleasure  and  to  find  out  if 
the  boys  capture  this  elusive  animal. 

109.  With  the  use  of  the  words  drowsy,  drowsier,  drowsiest  and  woozy,  discuss  with 
pupils  the  effect  upon  a  final  "y"  when  inflectional  suffixes  are  added.  Have 
students  suggest  words  that  they  know  which  would  change  a  final  "y"  to  "i" 
before  adding  the  suffix. 

no.    After  practicing  figurative  language  terms,  have  the  students  create  a  written 
list  of  figurative  expressions  to  describe  common  household  articles. 
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Objective  12 

Monitor  comprehension  development  of  students  by  type  of  specific  compre- 
hension skill  and  by  type  of  content  being  used, 


Directions:    The  following  scenerio  is  to  be  considered  a  typical  reading  exercise 
consisting  of  a  statement  of  purpose  for  reading  the  story,  the  passage 
to  Be  read,  and  five  comprehension  questions  that  might  be  asked  about 
the  story. 

Read  the  purpose  setting  statement,  the  passage  itself  and  the  compre- 
hension questions  which  follow  and  then  decide  which  type  of  information 
the  question  is  designed  to  elicit,    Mark  "A"  for  literal;  "B"  for 
implied;  "C"  for  vocabulary;  "D"  for  evaluative;  and  "E"  for  the  purpose 
setting  question, 

The  comprehension  questions  are  of  the  following  four  types: 


A.  Literal 


B.  Implied: 


C.    Vocabul ary: 


D,  Evaluative: 


question  asks  information  which  is  provided  directly 
in  the  passage, 

question  asks  for  information  which  is  not  provided 
directly  but  is  strongly  suggested  by  the  structure 
and  wording  in  the  passage. 

question  requires  knowledge  of  the  meaning(s)  of  a 
word  used  in  the  passage  which  can  be  considered  to 
be  a  new,  specialized  or  infrequent  word  in  the 
reading  vocabulary  for  that  level. 

question  requires  that  the  reader  interact  with  infor- 
mation either  provided  or  implied  in  the  passage  and 
provide  a  personal  decision  regarding  the  meaning, 
logic,  credibility  or  emotional  impact  of  the  passage 
as  it  applied  to  them. 


Purpose:     Read  to  find  out  why  Martians  and  Earthlings  would  have  a  hard  time 
being  friends. 
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Objective  12  (continued) 


Passage: 

One  strange  and  restless  night,  Kim  Anderson  began  a  walk  that  would  take  her 
away  from  the  security  of  her  house  and  into  an  unknown  world  of  creatures  much  dif- 
ferent from  any  of  her  friends, 

Kim  arose  from  her  bed  and  wandered  through  the  darkness  to  a  shadowy  space 
lighted  by  the  glow  of  a  Martian  flying  saucer.  Tripping  over  her  own  feet,  and 
falling  solidly  to  the  earth,  Kim  awoke, 

Somehwat  confused,  she  was  fascinated  by  the  sight  of  the  craft  and  advancing 
closer  she  decided  to  go  aboard, 

Armaness,  a  Martian,  greeted  her  with  information  that  she  was  being  taken  away 
for  study  on  his  planet,  There  they  hoped  to  find  out  whether  his  people  and  Earth- 
lings  could  6e  friends.    Within  moments  the  saucer  was  airborne, 

The  experiment  began  immediately,    Kim  was  asked  to  fix  lunch  for  Armaness  and 
three  friends.    She  discovered  some  quite  appealing  "umbo  ice  curds,"  much  like  her 
own  favorite  peach  sherbet.    To  each  of  the  four  Martians  seated  at  the  table  she 
served  a  glass  of  "swom,"  red  like  tomatoes  and  eaten  with  a  straw.    As  she  served 
Armaness,  the  glass  slipped  and  flew  straight  into  his  lap  and  the  bowl  of  "umbo" 
plopped  onto  his  head. 

After  cleaning  up  she  proceeded  to  cook  a  bowl  of  "sanzellarder. "    Mo  instructions 
were  provided,  so  a  safe  choice  should  be  to  bake  it,  like  most  earthly  casseroles. 
She  slid  it  into  a  nearby  microwave  oven.    Unfortunately  the  Martian  microwave  made 
an  Earthling's  seem  like  an  old  woodburner. 

The  "sanzellarder"  cooked  too  rapidly,  burned  brightly  for  a  moment,  and  dis- 
integrated under  a  puff  of  blue  smoke,  leaving  a  small  pile  of  broken  glass. 

Armaness  was  obviously  upset.    Tonight  he  would  be  hungry, 

Realizing  that  friendship  was  unlikely,  Armaness  immediately  turned  the  saucer 
around.    Dipping  low  over  the  rooftops  and  slowing  only  slightly,  they  dumped  Kim 
out. 

A  little  bruised  and  definitely  tired,  Kim  watched  the  shio  disappear.  "I 
never  really  liked  green  anyway,"  she  shouted. 
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Objective  12  (continued) 


Questions: 


m.    Kim  was  caputred  by  a  creature  named? 

a.  Umbo  c.  Martian 

b,  Armaness  d.  Earth! ina 


112.    "Airborne"  (paragraph  4)  means? 

a,  had  a  baby  in  the  air  c,  needed  air  to  live 

b,  carried  air  around  d,  took  off  into  the  a 


113.    When  Kim  watched  the  saucer  fly  away  she  felt? 

a,  disappointed  c,  silly 

b.  afraid  d,  relieved 


114.    At  dinner  Kim  spilled   on  Armaness? 

a.  peach  sherbet  c.  "sanzel larder" 

b.  "swom"  d.  two  of  the  above 


115.    The  "swom"  that  Kim  served  was  probably  a? 


a.  meat 

b.  fruit 


c.  vegetable 

d.  drink 
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Objective  1 

Administer  properly  the  assessment  tests  for  diagnosis  and  prescription. 


Directions:    The  following  is  a  typical  set  of  general  and  specific  directions 

for  administering  a  standardized  reading  achievement  test.    They  are 
to  be  read,  and  used  for  references,  in  formulating  your  responses 
to  the  following  set  of  hypothetical  testing  situations. 


** IMPORTANT  NOTE** 


In  order  to  insure  the  validity  of  testing  results,  all  pupils  must  be 
tested  under  the  same  conditions  with  respect  to  the  directions  in  this 
manual.    The  test  administrator  should  therefore  provide  himself  with 
time  for  thorough  study  of  the  tests  and  the  test  procedures  prior  to 
administration, 


Test  Scheduling 

1.  The  following  schedule  of  sittings  is  only  suggested,  but  no  more  than  two 
sittings  per  day  is  recommended  and  the  tests  must  be  completed  within  one 
week's  time. 

2.  Tests  whose  adequate  completion  time  is  questionable  should  not  be  started. 

3.  Tests  time  limits  must  be  adhered  to  exactly,  except  that  time  may  be 
called  if  ALL  pupils  complete  the  test  before  the  time  limit  expires. 


Before  Testing 

1.  Provide  a  door  sign  to  prohibit  interruptions. 

2.  Seat  pupils  where  they  cannot  copy  from  each  other.  Unsatisfactory 
first  seating  arrangements  may  be  modified  for  later  sittings. 

3.  Remove  all  non-testing  material  from  pupil's  desks. 
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Objective  1  (continued) 

4.    Cover  and/or  remove  all  wall  materials  that  may  aid  students  on  the  tests. 

During  Administration 

1,  Read  all  directions  to  students  verbatim,  but  in  a  natural  manner  and  atmos- 
phere, 

2,  Directions  may  be  discussed  and  explained  before  testing  begins. 

3,  Sample  items  may  be  discussed  and  explained,  but  additional  examples 
should  not  be  provided, 

4,  Unless  a  disturbance  interferes  with  a  pupil's  hearing,  all  teacher  dic- 
tated items  are  to  be  read  only  once. 

5,  Once  a  test  is  underway,  the  teacher  may  unobtrusively  clarify  instructions 
individually,  but  no  specific  item  help  should  be  given. 

6,  Testing  time  limits  should  only  be  given  out  if  students  request  them. 


Using  the  directions  printed  above  and  your  knowledge  of  appropriate  test  adminis- 
tration practices  select  one  of  the  four  answer  choices  given  below  that  most  accurately 
characterizes  each  of  the  following  ten  testing  situations. 


A.  Correct  according  to  general  and  specific  directions  for  test  administration. 

B.  An  acceptable  decision  that  should  not  affect  validity, 

C.  An  unfortunate  situation  with  undeterminable  effect  on  validity, 

D.  An  apparent  violation  of  the  general  and/or  specific  directions  for  the 
test  administration. 
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Objective  1  (continued) 

116,  While  leafing  through  a  copy  of  the  test  his  class  is  busy  taking,  Mr.  Z  notes 
a  vocabulary  word  in  one  of  the  reading  passages  that  Johnny  missed  studying 
the  day  he  was  absent.    Wanting  to  be  fair  to  Johnny,  Mr,  Z  calls  Johnny  to  his 
desk  and  pointing  out  the  word,  whispers  to  him  the  definition. 

117.  Standing  before  the  class,  Mr.  L  is  startled  as,  from  behind  him,  a  high  pitched 
squeal  cuts  through  his  pronounciation  of  the  fourth  word  of  the  oral  vocabulary 
test  he  is  dictating.    Mary  timidly  requests  that  he  repeat  the  last  word  called 
as  she  could  not  hear  it  clearly,    Hesitating  a  moment,  Mr.  L  observes  no  further 
requests  and  proceeds  to  the  rear  of  the  classroom  where  he  softly  repeats  the 
word  for  Mary, 

118,  With  this  being  her  first  standardized  test  administration,  Ms.  T  was  careful 
to  prepare  ahead  of  time,    She  had  her  "Do  Mot  Disturb"  sign  out,  had  the  desks 
well  spaced  and  had  the  children  remove  their  books  from  the  desks.    As  the  test 
got  under  way,  she  was  walking  around  the  room  when  she  noticed  the  vowel  chart 
still  hanging  on  the  wall  behind  her  desk.    Hoping  not  to  be  noticed,  she  con- 
tinued her  movement  until  her  rounds  took  her  back  to  the  front  of  the  room. 
Reaching  up  she  pulled  loose  the  thumb  tacks,  lowered  the  poster  and  set  it  on 
the  floor,  face  backward,  against  the  wall. 

119.  Having  given  standardized  tests  for  many  years,  Mr.  R  made  certain  that  he  took 
home  his  directions  booklet  the  night  before  the  tests.    He  planned  to  review 
the  directions  the  next  morning  as  v/as  his  usual  habit  of  arising  early  to  do 
his  planning.    An  unexpected  power  failure  during  the  night  caused  his  alarm 

to  ring  45  minutes  later  than  usual.    Realizing  this  he  quickly  dressed,  ate 
and  left  for  school,  figuring  that    he  would  skip  coffee  that  morning  and 
spend  those  five  minutes  on  reviewing  the  page  just  as  the  first  period  tardy 
bell  rang.    He  passed  out  the  materials  and  except  for  a  few  confusing  moments, 
was  able  to  complete  over  half  of  the  five  test  sittings  this  first  day, 


Objective  2 

For  the  questions  below,  use  the  results  of  the  standardized  test  scores  on  the 
following  page  to  determine  the  status  of  each  of  the  children's  reading  achievement 
relative  to  (within  the  acceptable  limits  of)  their  ability: 

a.  below  acceptable  limits  for  potential  (disability) 

b,  within  acceptable  limits  for  potential  (developmental) 

c,  above"  acceptable  limits  for  potential  (overachiever) 

d.  NOT  determinable  from  available  data 

120,    Joan's  performance  is  ^  


121,    Michael's  performance  is 


122.    Jerri's  performance  is 
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Appendix  B  (continued) 

Objective  #14      Evaluate  the  difficulty  level  of  reading  material  used. 

Directions:    Below  are  printed  3  pairs  of  narrative  passages  at  varying  levels  of 
reading  difficulty. 


In  your  capacity  as  a  reading  teacher  you  are  to  evaluate  the  relative 
difficulty  of  these  materials  and  recommend  the  material  of  lesser  diffi- 
culty.   If  both  selections  of  any  given  pair  appear  to  be  of  approximately 
equal  difficulty,  you  should  make  no  recommendation  and  let  the  student's 
choice  prevail . 

For  each  of  the  following  pairs,  mark  the  letter  (A  or  B)  of  the  easier 
passage.    If  both  are  approximately  the  same,  mark  a  "C."    If  you  cannot 
decide,  mark  "D." 

123.  (a)    Kim  had  been  observing  the  stars  through  his  telescope  for  quite  awhile.  He 

had  seen  the  usual  stars  but  was  disappointed  his  telescope  couldn't  reach  fur- 
ther into  the  galaxy.    Suddenly,  he  became  aware  of  a  sight  he  hadn't  seen  before 
Kim  glanced  away  then  refocused  his  telescope.    The  light  was  still  there,  mov- 
ing at  a  regular  pace  through  the  sky.    Would  he  dare  leave  his  telescope  to 
tell  someone  about  the  strange  object.    (73  wds.) 

(b)    It  was  Brad's  turn  to  deliver  his  speech  for  his  class.    His  report  was  to 
analyze  the  town's  efforts  at  improving  the  environment.    Brad  had  researched 
the  local  newspaper,  talked  with  local  engineers  and  had  formulated  a  checklist 
of  ways  to  improve  the  environment.    He  still  wasn't  sure  if  all  his  efforts 
had  produced  an  outstanding  speech.    Very  hesitantly  Brad  made  his  way  to  the 
front  of  the  room.    Slowly  he  started  his  speech.    (72  wds.) 

124.  (a)    The  boy  scouts  were  having  a  great  time  at  their  annual  swimming  party  at  the 

Rainbow  River.    Bill  had  been  swimming  for  about  an  hour  and  needed  some  rest. 
Suddenly,  he  heard  a  boy  yelling  who  was  having  trouble  getting  to  the  shore. 
As  Bill  swam  to  the  boy,  he  called  to  the  other  scouts  for  help.    (57  wds.) 

(b)    The  boat  floated  gently  in  the  stream.    A  mother  duck  with  her  baby  ducks  bobbed 

in  the  water  hunting  for  bugs.    It  was  a  perfect  day  for  a  picnic  lunch  and 

some  fishing.    Tommy  and  Matt  had  not  caught  any  fish,  but  no  one  seemed  to 

care.    They  enjoyed  the  quiet  ride  in  the  small  boat.    (56  wds.) 

125.  (a)    What  a  bumpy  sidewalkl    John  had  never  noticed  how  uneven  it  was  until  today. 

Standing,  or  rather  wobbling,  in  his  new  roller  skates,  he  looked  at  the 
cracks  and  leaves  on  the  sidewalk  with  a  renewed  interest.    He  saw  himself 
racing  down  the  street  fast  as  the  wind.    But  he  was  a  long  way  from  that 
image.    (57  wds. ) 

(b)    The  newspaper  ad  had  read,  "Six  week  old  puppies  for  sale.    Cheap.  Come 
by  26  Maple  between  2  and  5  p.m."    It  would  be  a  perfect  gift  for  Tim's 
birthday.    But  now  having  arrived,  the  puppies  had  all  been  sold.  Tim 
was  going  to  be  very  sad.    He  had  his  mind  made  up.    All  he  wanted  for 
his  birthday  was  a  puppy.    (64  wds.) 
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Appendix  B  (continued) 


Objective  lOA 

Devise  teaching  strategies  for  aiding  students  to  acquire  a  recognition 
vocabulary  (phonic  analysis). 

Directions:    For  this  part  of  the  test,  you  are  to  assume  the  situation  of  listening 
to  a  student  attempt  to  pronounce  the  nonsense  words  listed  below.  The 
actual  pronunciations  produced  by  the  student  follow  the  word  and  are 
enclosed  in  //'s.    You  are  to  select  from  the  choices  given,  the  generali- 
zation that  is  correctly  stated,  applicable  to  the  error  and  would  be  of 
benefit  to  the  student  in  preventing  these  types  of  mispronunciations  in 
the  future.    If  the  pronunciation  is  correct,  select  choice  "e." 


126.  zleck:    (pronounced  as  /zlek/).  Generalization: 

a.  an  exceptional  situation  where  e_  followed  by  £  is  always  short. 

b.  a  single  vowel  in  an  open  syllable  is  usually  short. 

c.  a  single  vowel  followed  by  a  consonant  is  usually  short. 

d.  a  single  £  in  a  closed  syllable  is  pronouned  as  "schwa." 

e.  the  word  was  correctly  pronounced. 

127.  ible:    pronounced  /i.bl  /  ).  Generalization: 

a.  a  vowel  followed  by  final  e  is  usually  long,  while  the  e^  is  silent. 

b.  vowel -consonant-l e  is  a  phonogram  where  £  is  a  schwa  and  precedes  the  1_  in 
pronunciation. 

c.  a  single  vowel  followed  by  a  consonant-le  is  usually  short. 

d.  the  pattern  vowel -consonant-le  is  all  pronounced  as  a  single  blend, 

e.  the  word  was  correctly  pronounced. 

128.  ceze:    (pronounced  /s?.z  /).  Generalization: 

a.  when  a  word  has  two  vowels,  and  one  is  a  final  e;  the  first  is  usually  long, 
the  e_  is  silent. 

b.  a  vowel  in  an  open  syllable  is  usually  long. 

c.  a  final  £  can  be  silent  or  "schwa." 

d.  when  e_  precedes  and  follows  zj,  the  first  e_  is  long,  second  e  is  silent. 

e.  the  word  is  correctly  pronounced. 

129.  torist:    (pronounced  /tF-rist/).  Generalization: 

a.  £  followed  by  _r  is  pronounced  as  "long  o." 

b.  o_  followed  by  r_  is  pronounced  as  "short  o." 

c.  £  followed  by  r_  is  neither  long,  nor  short;  it  is  "r-controlled. " 

d.  £  followed  by  r_  is  neither  long,  nor  short;  it  is  "schwa." 

e.  the  word  is  correctly  pronounced. 

130.  rukker:    (pronounced  /ruk-ker/).  Generalization: 

a.  £  produces  a  short  sound  when  followed  by  an  er. 

b.  u_ and  e_ in  closed  syllables  produce  short  voweT  sounds. 

c.  u_  and  e^  produced  the  same  sound. 

d.  e_fonov;ed  by  an  r  is  "r-controlled." 

e.  the  word  is  correctly  pronounced. 
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Appendix  B  (continued) 
Objective  4  (continued) 

Directions:    Utilizing  the  data  above,  select  the  answer  that  best  reflects  your 
decisions  for  organizing,  placing  and  instructing  students. 


131.    For  the  purpose  of  graded  vocabulary  development  activities,  the  best  grouping 
would  be: 


a.  1  -  Mary,  Jane  2  -  Beth,  Mike 

b.  1  -  Mike,  Mary,  Jane  2  -  Beth,  Ricky 

c.  1  -  Mike,  Ricky,  Beth  2  -  Mary,  Jane 

d.  1  -  Mary,  Jane,  Mike  2  -  John,  Ricky,  Beth 


3  -  John,  Ricky 
3  -  John 
'3  -  John 
3  -  None 


132.    For  the  purpose  of  skill  development  and  practice  in  phonics,  the  two  students 
whose  profiles  indicate  the  need  for  individualized  instruction  are: 

a.  Ricky,  Mike 

b.  Beth,  Mary 

c.  Ricky,  John 

d.  Jane,  Mary 


133.    Of  all  the  students  profiled  above,  the  student  who  should  not  be  grouped 
with  Mike  for  study  skills  work  is: 


a.  Beth 

b.  Mary 

c.  Jane 

d.  Ricky 


134.    The  student  above  whose  profile  most  strongly  suggests  a  reading  disability 
is: 

a.  Ricky 

b.  Beth 

c.  Mike 

d.  Mary 


135.    The  student  above  whose  profile  is  most  typically  that  of  a  developmental 
youngster  is: 

a.  Jane 

b.  Beth 

c.  Mary 

d.  Mike 
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Appendix  B  (continued) 
Objective  10-B 

Directions:    The  following  5  items  focus  on  the  principles  of  syllabication.  Each 
item  presents  a  nonsense  word  whose  letter  patterns  resemble  real 
English  words.    Assume  you  are  instructing  a  child.    For  each  of  the 
items  select  the  strategy  most  appropriate  for  use  in  successfully 
decoding  the  word. 


136.  leffing 

A.  Should  recognize  (vccv)  and  divide  between  consonants. 

B.  Should  recognize  phonogram  ing  and  detach  it. 

C.  Should  recognize  ff  as  blend  and  divide  before  them. 

D.  Should  recongize  "silent  vowel"  and  not  attempt  division. 

137.  disibbear 

A.  Should  recognize  (vcv)  and  (vccv)  and  divide  after  i_  and  between  b^'s. 

B.  Should  recognize  prefix  and  (vccv)  and  detach  prefix,  then  split  con- 
sonants. 

C.  Should  recognize  (vcv)  and  treat  bb^  as  one  sound;  divide  after  first 
vowel s. 

D.  Should  recognize  prefix  and  suffix  on  word;  detach  both  leaving  base 
word. 

138.  maffler 

A.  Should  recognize  ff  blend,  apply  (vccv)  and  divide  after  f_'s. 

B.  Should  recognize  fl_  blend,  apply  (vccv)  and  divide  between  f's. 

C.  Should  recognize  ffl  blend,  apply  (vcv)  and  divide  after  a_. 

D.  Should  recognize  le  ending  and  divide  between  f_'s. 

139.  undergeight 

A.  Should  recognize  compound,  detach  it  and  apply  (vccv)  to  word. 

B.  Should  recognize  (vccv),  (vccv),  and  (vcv)  respectively;  divide  after 
ri,  r,  and  i_. 

C.  Should  recognize  (vccv),  "silent  e"  and  i£h_  phonogram;  divide  after  n 
and  before  i_.  ~ 

D.  Should  recognize  prefix  and  detach,  apply  (vccv),  then  apply  (vcv). 

140.  raxes 

A.  Should  recognize  (vcv)  and  divide  after  a_. 

B.  Should  recognize  ax  as  phonogram,  dividing  after  the  x. 

C.  Should  recognize  that  _x  attaches  to  the  preceding  vowel  to  end  a  syllable. 

D.  Should  recognize  x_  produces  two  sounds  and  should  be  split  in  half. 
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Appendix  B  (continued) 
Objective  3 

Determine  functional  reading  levels  for  placement  in  reading  material. 

Directions:    During  this  activity  you  will  hear  students  reading  the  passages 
printed  below.    While  listening  to  each  student  read  the  passage, 
you  are  to  decide  whether  the  material  in  that  passage  is  too  easy, 
too  hard,  or  appropriate  for  instructional  use  with  that  student. 

Mark  answer  choice  "A"  if  the  material  is  too  easy.    Mark  answer 
choice  "B"  if  the  material  is  too  hard.    Mark  "C  if  the  material 
is  appropriate  for  instruction.    Mark  "D"  if  you  cannot  make  a 
determination. 


Ron  (reading  5th  grade  level  material) 


John  had  been  given  two  weeks  to  do  an  assignment  on  a  modern  day 
hero.    He  told  his  parents  he  had  plenty  of  time  to  do  the  paper  and 
would  start  it  the  next  day.    Now  the  paper  was  due  tomorrow  and  he  hadn't 
started  it.    His  parents  refused  to  take  him  to  the  library  so  late  in  the 
evening.    John  had  gotten  himself  in  a  bind.    He  wondered  where  the  two 
weeks  had  disappeared.    (73  words) 


141.  Ron 

A.  too  easy 

B.  too  hard 

C.  appropriate 

D.  can't  decide 


Jack  (reading  4th  grade  level  material) 


All  the  neighborhood  had  their  house  lights  on.    First  the  children  were 
going  to  have  a  parade.    Then  the  boys  and  girls  would  be  walking  from  house 
to  house  to  get  their  treats.    They  would  have  to  shout  "Trick  or  Treat"  first. 
It  was  going  to  be  the  best  Halloween  ever.    (61  words) 


142.  Jack 

A.  too  easy 

B.  too  hard 

C.  appropriate 

D.  can't  decide 
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Appendix  B  (continued) 
Objective  3  (continued) 


Culver  (reading  6th  grade  level  material) 


The  divers  had  been  working  for  months  now.    Their  maps  were  up  to  date  but 
they  felt  frustrated  by  their  attempts  to  find  any  evidence  of  the  lost  island. 
Maybe  the  submerged  island  was  just  a  fantasy  after  all.    When  they  started 
their  search,  it  seemed  so  real.    Now  it  became  more  a  myth  than  ever.  (56 
words) 


143.  Culver 

A.  too  easy 

B.  too  hard 

C.  appropriate 

D.  can 't  decide 


Shelly  (reading  5th  grade  level  material) 


The  tornado  struck  quite  unexpectantly.    Most  people  were  awakened  by 
the  sound  of  the  howling  wind.    Suddenly  the  wind  became  so  fierce  that  windows 
and  roofs  were  shattered  by  the  uprooted  trees.    After  the  tornado  had  passed 
and  the  shock  had  subsided,  the  citizens  could  attend  to  the  task  of  cleaning 
up  from  the  storm.  (55  words) 


144.  Shelly 

A.  too  easy 

B.  too  hard 

C.  appropriate 

D.  can't  decide 


Jason  (reading  4th  grade  level  material) 


The  clipper  ship  was  speeding  in  the  ocean.    The  captain  had  a  large  and 
expensive  cargo  to  get  to  France.    He  was  afraid  of  pirate  ships  overtaking  him 
and  stealing  the  precious  cargo.    Then  on  the  horizon,  against  the  bright  sun, 
the  captain  saw  the  outline  of  another  ship.    Hastily  he  ordered  his  men  to 
prepare  themselves  for  battle.    (59  words) 


145.  Jason 

A.  too  easy 

B.  too  hard 

C.  appropriate 

D.  can't  decide 


APPENDIX  C 


DATA  ON  THE  INSTRUMENTATION 


PILOT  STUDY  I 

1.  Summary  Statistics  for  Test 

2.  Frequency  Distribution  of  Scores 

3.  Item  Response  Analysis 


PILOT  STUDY  II 

1.  Summary  Statistics  for  Test 

2.  Frequency  Distribution  of  Scores 

3.  Item  Response  Analysis 


GATER-K  RESULTS 

1.  Summary  Statistics  for  Test 

2.  Frequency  Distribution  of  Scores 

3.  Item  Response  Analysis 


GATER-P  RESULTS 

1.  Summary  Statistics  for  Test 

2.  Frequency  Distribution  of  Scores 

3.  Item  Response  Analysis 


GATER-K  AND  GATER-P  SUBTEST  RESULTS 

1.  Subtests  Summary  Statistics 

2.  Subtests  Intercorrelation  Matrix 
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Appendix  C  (continued) 

PILOT  STUDY  I 


Number  of  Students  Taking  Test  24.00 

Total  Number  of  Items  on  Exam  92.00 

Range  of  Scores  —  High  =  51.00 

—  Low   =  13.00 

Highest  Possible  Score  87.00 

Mean  (Average)  Raw  Score  29.25 

Median  (Middle)  Raw  Score  28.50 

Mode  (Most  Frequent)  Raw  Score  29.00 

Standard  Deviation  (Raw  Score)  8.69 

Standard  Error  of  Measurement  3.35 

Kuder-Richardson  20  Correlation  0.85 

Number  Used  for  Disc  Index  6.00 


Frequency  Distribution  of  Scores 


Raw 

Percent 

Fre- 

Z 

Percentile 

Numerical 

Score 

Score 

quency 

Score 

Rank 

Rank 

13 

14.94 

1 

-1.87 

2.08 

24 

18 

20.69 

1 

-1.29 

6.25 

23 

20 

22.99 

2 

-1.06 

12.50 

21 

23 

26.44 

1 

-0.72 

18.75 

20 

25 

28.74 

2 

-0.49 

25.00 

18 

26 

29.89 

1 

-0.37 

31.25 

17 

27 

31 .03 

2 

-0.26 

37.50 

15 

28 

32.18 

2 

-0.14 

45.83 

13 

29 

33.33 

3 

-0.03 

56.25 

10 

30 

34.48 

2 

0.09 

66.67 

8 

31 

35.63 

1 

0.20 

72.92 

7 

33 

37.93 

1 

0.43 

77.08 

6 

34 

39.08 

1 

0.55 

81.25 

5 

35 

40.23 

1 

0.66 

85.42 

4 

45 

51.72 

1 

1.81 

89.58 

3 

46 

52.87 

1 

1.93 

93.75 

2 

51 

58.62 

1 

2.50 

97.92 

1 
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Appendix  C  (continued) 

PILOT  STUDY  II 


Number  of  Students  Taking  Test  33.00 

Total  Number  of  Items  on  Exam  45.00 

Range  of  Scores  —  High  =  40.00 

---  Low  =  24.00 

Highest  Possible  Score  45.00 

Mean  (Average)  Raw  Score  34.61 

Median  (Middle)  Raw  Score  35.00 

Mode  (Most  Frequent)  Raw  Score  33.00 

Standard  Deviation  (Raw  Score)  4.66 

Standard  Error  of  Measurement  2.41 

Kuker-Richardson  20  Correlation  0.73 

Number  Used  for  Disc  Index  8.00 


Frequency  Distribution  of  Scores 


Raw 

Percent 

Fre- 

Z 

Percentile 

Numerical 

Score 

Score 

quency 

Score 

Rank 

Rank 

24 

53.33 

2 

-2.28 

3.03 

32 

25 

55.56 

1 

-2.06 

7.58 

31 

29 

64.44 

1 

-1.20 

10.61 

30 

30 

66.67 

1 

-0.99 

13.64 

29 

31 

68.89 

2 

-0.77 

18.18 

27 

32 

71.11 

2 

-0.56 

24.24 

25 

33 

73.33 

5 

-0.34 

34.85 

20 

34 

75.56 

2 

-0.13 

45.45 

18 

35 

77.78 

1 

0.08 

50.00 

17 

36 

80.00 

2 

0.30 

54.55 

15 

37 

82.22 

1 

0.51 

59.09 

14 

38 

84.44 

5 

0.73 

68.18 

9 

39 

86.67 

3 

0.94 

80.30 

6 

40 

88.89 

5 

1.16 

92.42 

1 
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Appendix  C  (continued)  GATER-K  RESULTS 

Number  of  Students  Taking  Test  168.00 

Total  Number  of  Items  on  Exam  100.00 

Range  of  Scores  —  High  =  76.00 

—  Low  =  17.00 

Highest  Possible  Score  100.00 

Mean  (Average)  Ravi  Score  46.71 

Median  (Middle)  Raw  Score  50.00 

Mode  (Most  Frequent)  Raw  Score  50.00 

Standard  Deviation  (Raw  Score)  14.28 

Standard  Error  of  Measurement  4.45 

Kuder-Richardson  20  Correlation  0.90 

Number  Used  for  Disc  Index  45.00 


Frequency  Distribution  of  Scores 


Raw 

Percent 

Fre- 

Z 

Percentile 

Numerical 

Score 

Score 

quency 

Score 

Rank 

Rank 

17 

17.00 

1 

-2.08 

0.30 

168 

IQ 
lo 

lo.UU 

o 
c 

0  m 
-(C  .0  1 

1  in 
1.19 

lob 

ly.uu 

1 

- 1  .94 

0  no 

ICC 

lob 

on  nn 
cU.  UU 
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Appendix  C  (continued) 


Frequency  Distribution  of  Scores 
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Frequency  Distribution  of  Scores 
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Appendix  C  (continued)  satER-P  RESULTS 

Number  of  Students 
Total  Number  of  Items  on  Exam 
Range  of  Scores  —  High  = 
—  Low  = 
Highest  Possible  Score 
Mean  (Average)  Raw  Score 
Median  (Middle)  Raw  Score 
Mode  (Most  Frequent)  Raw  Score 
Standard  Deviation  (Raw  Score) 
Standard  Error  of  Measurement 
Kuder-Richardson  20  Correlation 
Number  Used  for  Disc  Index 
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APPENDIX  D 

EXPERIENCE  AND  TRAINING  CHARACTERISTICS  IN  THE  POPULATION 
Teaching  Experience  in  the  Population 


Years  of  Absolute 
Experience  Frequency 


0 

30 

1 

3 

2 

9 

3 

6 

4 

5 

5 

9 

6 

8 

7 

o 
O 

8 

9 

9 

10 

10 

5 

11 

6 

12 

6 

13 

3 

14 

3 

15 

3 

16 

3 

17 

1 

18 

1 

19 

1 

20 

2 

23 

3 

24 

3 

26 

1 

29 

1 

31 

3 

34 

1 

37 

1 

TOTAL  144 


Relative 

Cumulative 

Frequency 

Frequency 

20.8 

20.8 

2.1 

22.9 

6.3 

29.2 

4.2 

33.3 

3.5 

36.8 

6.3 

43.1 

5.6 

48.6 

5.6 

54.2 

6.3 

60.4 

6.9 

67.4 

/U.o 

4.2 

75.0 

4.2 

79.2 

2.1 

81.3 

2.1 

83.3 

2.1 

85.4 

2.1 

87.5 

0.7 

88.2 

0.7 

88.9 

0.7 

89.6 

1.4 

91.0 

2.1 

93.1 

2.1 

95.1 

0.7 

95.8 

0.7 

96.5 

2.1 

98.6 

0.7 

99.3 

0.7 

100.0 

100.0 
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Appendix  D  (continued) 


Experience  in  Teaching  Reading  in  the  Population 


Years  of 

Absol ute 

Rel ati ve 

Lumu  1  an  ve 

Experience 

Frequency 

Frequency 

Frequency 

0 

73 

50.7 

50.7 

1 

6 

4.2 

54.9 

2 

7 

4.9 

59.7 

3 

8 

5.6 

65.3 

4 

8 

5.6 

70.8 

5 

6 

4.2 

75.0 

6 

4 

2.8 

77.8 

-7 

/ 

4 

0  Q 
C.O 

OU  .  0 

8 

7 

4.9 

85.4 

9+ 

21 

14.6 

100.0 

TOTAL 

144 

100.0 

Degree  Levels 

in  the  Population 

Degree 

Absolute 

Relative 

Cumulative 

Level 

Frequency 

Frequency 

Frequency 

Junior 

3 

2.1 

2.1 

Senior 

24 

16.7 

18.8 

B.A./B.A. 

70 

48.6 

67.4 

Masters 

29 

20.1 

87.5 

Post  M.A. 

11 

7.6 

95.1 

Special ist 

3 

2.1 

97.2 

Doctors 

4 

2.8 

100.0 

TOTAL 

144 

100.0 
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Appendix  D  (continued) 


Area  of  Specialization  (Major)  in  the  Population 

Major  Absolute  Relative  Cumulative 

Area  Frequency  Frequency  Frequency" 


Art  Ed.  2  1.4  1.4 

Reading 

Certification  28  19.4  20.8 

Elementary  Ed.  54  37.5  58.3 

Home  Ec.  1  0.7  59.0 

Ind.  Arts  2  1.4  60.4 

Lang.  Arts/Eng.  5  3.5  63.9 

Math  Ed.  1  0.7  64.6 

Music  Ed.  2  1.4  66.0 

Physical  Ed.  2  1.4  67.4 

Special  Ed.  8  5.6  73.0 

Social  Studies  4  2.8  75.8 

Administration  2  1.4  77.2 

Other  6  4.2  81.4 

Pre-service  _27^  18.8  100.2 

TOTAL  144  100.0 
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Appendix  D  (continued) 


Number  of  Reading  Courses 

in  the  Population 

Reading 
Courses 

Absol ute 
Frequency 

Relative 
Frequency 

Cumulative 
Frequency 

0 

10 

6.9 

6.9 

1 

33 

22.9 

29.9 

2 

36 

25.0 

54.9 

3 

18 

12.5 

67.4 

4 

9 

6.3 

73.6 

5 

6 

4.2 

77.8 

6 

6 

4.2 

81.9 

7 

7 

4.9 

86.8 

8 

5 

3.5 

90.3 

9  or  More 

14 

9.7 

100.0 

TOTAL 

144 

100.0 
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